aljaz/Auto-GPT
1
0
Fork 0
mirror of https://github.com/aljazceru/Auto-GPT.git synced 2026-01-31 11:54:30 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
e641cccb42836766e1004e60324a9466fabe9bad
Auto-GPT/benchmark
History
Reinier van der Leer e641cccb42 chore(benchmark): Update aiohttp and fastapi dependencies to mitigate vulnerabilities 
Addressed vulnerabilities:

- python-multipart vulnerable to Content-Type Header ReDoS - https://github.com/Significant-Gravitas/AutoGPT/security/dependabot/55
   Dependants:
   - FastAPI Content-Type Header ReDoS - https://github.com/Significant-Gravitas/AutoGPT/security/dependabot/53
   - Starlette Content-Type Header ReDoS - https://github.com/Significant-Gravitas/AutoGPT/security/dependabot/48

- aiohttp is vulnerable to directory traversal - https://github.com/Significant-Gravitas/AutoGPT/security/dependabot/46
- aiohttp's HTTP parser (the python one, not llhttp) still overly lenient about separators - https://github.com/Significant-Gravitas/AutoGPT/security/dependabot/43
2024-02-13 12:21:52 +01:00
..
.vscode
Auto-GPT-20230905085638
2023-09-05 10:10:03 -07:00
agbenchmark
feat(benchmark): Add -N, --attempts option for multiple attempts per challenge
2024-01-22 17:16:55 +01:00
agbenchmark_config
Add more challenges + cleanup (#5368)
2023-09-27 17:58:58 -07:00
backend
Refactor benchmark (#5247)
2023-09-17 06:55:20 -07:00
frontend
Fix challenges (#5561)
2023-10-05 10:59:50 -07:00
notebooks
chore(benchmark): Upgrade OpenAI client lib from v0 to v1
2024-01-16 15:49:46 +01:00
reports
Structure challenges (#5296)
2023-09-21 20:06:37 -07:00
tests
Fix benchmark ci (#5478)
2023-10-02 12:41:32 -07:00
.env.example
Auto-GPT-20230905085638
2023-09-05 10:10:03 -07:00
.flake8
Auto-GPT-20230905085638
2023-09-05 10:10:03 -07:00
.gitignore
Add eval_id and sync Skill Tree with Frontend(#5287)
2023-09-21 13:36:17 -07:00
.pre-commit-config.yaml
Auto-GPT-20230905085638
2023-09-05 10:10:03 -07:00
.python-version
Auto-GPT-20230905085638
2023-09-05 10:10:03 -07:00
agents_to_benchmark.json
Rename Auto-GPT to AutoGPT (#5301)
2023-09-22 15:49:29 -07:00
LICENSE
Auto-GPT-20230905085638
2023-09-05 10:10:03 -07:00
mypy.ini
Auto-GPT-20230905085638
2023-09-05 10:10:03 -07:00
poetry.lock
chore(benchmark): Update aiohttp and fastapi dependencies to mitigate vulnerabilities
2024-02-13 12:21:52 +01:00
pyproject.toml
chore(benchmark): Update aiohttp and fastapi dependencies to mitigate vulnerabilities
2024-02-13 12:21:52 +01:00
README.md
Rename Auto-GPT to AutoGPT (#5301)
2023-09-22 15:49:29 -07:00
run.sh
Fixing benchmarks
2023-09-11 17:41:27 -07:00

README.md

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Screenshot 2023-07-25 at 10 35 01 AM

Ranking overall:

Detailed results:

Screenshot 2023-07-25 at 10 42 15 AM

Click here to see the results and the raw data!!

More agents coming soon !