add information retrieval challenge to the wiki (#3876)

This commit is contained in:
merwanehamadi
2023-05-06 09:48:08 -07:00
committed by GitHub
parent d184d0d235
commit ca5abff93f
3 changed files with 26 additions and 0 deletions

View File

@@ -0,0 +1,20 @@
# Information Retrieval Challenge A
**Status**: Current level to beat: level 1
**Command to try**:
```
pytest -s tests/integration/challenges/information_retrieval/test_information_retrieval_challenge_a.py
```
## Description
The agent's goal is to find the revenue of Tesla in 2022.
It should write the result in a file called output.txt.
The agent should be able to beat this test consistently (this is the hardest part).
## Objective
The objective of this challenge is to test the agent's ability to retrieve information in a consistent way.

View File

@@ -0,0 +1,3 @@
# Information Retrieval
Information retrieval challenges are designed to evaluate the proficiency of an AI agent, such as Auto-GPT, in searching, extracting, and presenting relevant information from a vast array of sources. These challenges often encompass tasks such as interpreting user queries, browsing the web, and filtering through unstructured data.

View File

@@ -24,6 +24,9 @@ nav:
- Introduction: challenges/memory/introduction.md - Introduction: challenges/memory/introduction.md
- Memory Challenge A: challenges/memory/challenge_a.md - Memory Challenge A: challenges/memory/challenge_a.md
- Memory Challenge B: challenges/memory/challenge_b.md - Memory Challenge B: challenges/memory/challenge_b.md
- Information retrieval:
- Introduction: challenges/information_retrieval/introduction.md
- Information Retrieval Challenge A: challenges/information_retrieval/challenge_a.md
- Submit a Challenge: challenges/submit.md - Submit a Challenge: challenges/submit.md
- Beat a Challenge: challenges/beat.md - Beat a Challenge: challenges/beat.md