aljaz/Auto-GPT
1
0
Fork 0
mirror of https://github.com/aljazceru/Auto-GPT.git synced 2025-12-17 22:14:28 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
7dffd1a4b7c199ff95de63199fa583be83e2986f
Auto-GPT/docs/challenges/information_retrieval/challenge_b.md
Reinier van der Leer dafbd11686 Rearrange tests & fix CI (#4596) 
* Rearrange tests into unit/integration/challenge categories

* Fix linting + `tests.challenges` imports

* Fix obscured duplicate test in test_url_validation.py

* Move VCR conftest to tests.vcr

* Specify tests to run & their order (unit -> integration -> challenges) in CI

* Fail Docker CI when tests fail

* Fix import & linting errors in tests

* Fix `get_text_summary`

* Fix linting errors

* Clean up pytest args in CI

* Remove bogus tests from GoCodeo
2023-06-06 10:48:49 -07:00

840 B
Raw Blame History

Information Retrieval Challenge B

Status: Beaten

Command to try:

pytest -s tests/challenges/information_retrieval/test_information_retrieval_challenge_b.py

Description

The agent's goal is to find the names, affiliated university, and discovery of the individuals who won the nobel prize for physics in 2010.

It should write the result in a file called 2010_nobel_prize_winners.txt.

The agent should be able to beat this test consistently (this is the hardest part).

Objective

The objective of this challenge is to test the agent's ability to retrieve multiple pieces of related information in a consistent way. The agent should not use google to perform the task, because it should already know the answer. This why the task fails after 2 cycles (1 cycle to retrieve information, 1 cycle to write the file)