mirror of
https://github.com/aljazceru/Auto-GPT.git
synced 2025-12-18 14:34:23 +01:00
dafbd11686
* Rearrange tests into unit/integration/challenge categories * Fix linting + `tests.challenges` imports * Fix obscured duplicate test in test_url_validation.py * Move VCR conftest to tests.vcr * Specify tests to run & their order (unit -> integration -> challenges) in CI * Fail Docker CI when tests fail * Fix import & linting errors in tests * Fix `get_text_summary` * Fix linting errors * Clean up pytest args in CI * Remove bogus tests from GoCodeo
24 lines
778 B
Markdown
24 lines
778 B
Markdown
# Information Retrieval Challenge A
|
|
|
|
**Status**: Current level to beat: level 2
|
|
|
|
**Command to try**:
|
|
|
|
```
|
|
pytest -s tests/challenges/information_retrieval/test_information_retrieval_challenge_a.py --level=2
|
|
```
|
|
|
|
## Description
|
|
|
|
The agent's goal is to find the revenue of Tesla:
|
|
- level 1 asks the revenue of Tesla in 2022 and explicitly asks to search for 'tesla revenue 2022'
|
|
- level 2 is identical but doesn't ask to search for 'tesla revenue 2022'
|
|
- level 3 asks for tesla's revenue by year since its creation.
|
|
|
|
It should write the result in a file called output.txt.
|
|
|
|
The agent should be able to beat this test consistently (this is the hardest part).
|
|
## Objective
|
|
|
|
The objective of this challenge is to test the agent's ability to retrieve information in a consistent way.
|