aljaz/Auto-GPT
1
0
Fork 0
mirror of https://github.com/aljazceru/Auto-GPT.git synced 2025-12-25 18:04:28 +01:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Douglas Schonholtz
2023-04-18 11:59:42 -04:00
committed by GitHub
parent 486c7e3a5e
commit f00ced6612
1 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -9,9 +9,8 @@ A set of standardised benchmarks to assess the performance of Auto-GPTs.
- [ ] Lower priority, but put this in a webserver backend so we have a good API rather than doing container and file management for our interface between evals and our agent.
- [ ] Get token counting data from the model Add scores to result files based on pricing associated with tokens and models used
- [ ] Think about how this can be applied to other projects besides AutoGPT so we can be THE agent evaluation framework.
- [ ] Figure our how the OpenAI Evals results are saved...
- [ ] Copy the OpenAI Eval files from the tmp file they are saved to somewhere we can track the results
- [ ] Support multi-threaded evals. OpenAI has great support for this. The docker system built here doesn't.
- [ ] Make the file logger/duplicate op checker more robust. It's not great right now.
## Understanding OpenAI Evals