mirror of
https://github.com/aljazceru/Auto-GPT.git
synced 2026-02-11 17:24:20 +01:00
Display smol-developer-results (#103)
This commit is contained in:
21
README.md
21
README.md
@@ -3,7 +3,7 @@
|
||||
A repo built for the purpose of benchmarking the performance of agents far and wide, regardless of how they are set up and how they work
|
||||
|
||||
## Scores:
|
||||
Spider chart for each agent coming soon !
|
||||
Radio chart for each agent coming soon !
|
||||
|
||||
## Detailed results
|
||||
:warning: These results are constantly evolving at the moment. We will publish an official benchmark result very soon.
|
||||
@@ -42,7 +42,7 @@ Interface
|
||||
| Task | Results |
|
||||
|-------------|--------------------|
|
||||
| Write File | :white_check_mark: |
|
||||
| Read File | :white_check_mark: |
|
||||
| Read File | :x: |
|
||||
| Search File | :x: |
|
||||
|
||||
Code
|
||||
@@ -58,4 +58,19 @@ Code
|
||||
Coming Soon!
|
||||
|
||||
### smol-developer
|
||||
Coming Soon!
|
||||
Interface
|
||||
|
||||
| Task | Results |
|
||||
|-------------|--------------------|
|
||||
| Write File | :white_check_mark: |
|
||||
| Read File | :x: |
|
||||
| Search File | :x: |
|
||||
|
||||
Code
|
||||
|
||||
| Task | Results |
|
||||
|-----------------------------------|----------------------|
|
||||
| Debug Simple Typo With Guidance | :x: |
|
||||
| Debug Simple Typo Without Guidance| :x: |
|
||||
| Basic Code Generation | :white_check_mark: |
|
||||
| Create Simple Web Server | :x: |
|
||||
|
||||
Submodule agent/smol-developer updated: aa82339250...f4f4395511
Reference in New Issue
Block a user