Show Auto-GPT results (#102)

This commit is contained in:
merwanehamadi
2023-07-14 18:04:35 -07:00
committed by GitHub
parent 281cb0ef37
commit 7de965ab3f
2 changed files with 36 additions and 2 deletions

View File

@@ -9,10 +9,44 @@ Spider chart for each agent coming soon !
:warning: These results are constantly evolving at the moment. We will publish an official benchmark result very soon.
### Auto-GPT
Coming Soon!
Interface
| Task | Results |
|--------------|---------------------|
| Write File | :white_check_mark: |
| Read File | :white_check_mark: |
| Search File | :x: |
Code
| Task | Results |
|-----------------------------------|----------------------|
| Debug Simple Typo With Guidance | :x: |
| Debug Simple Typo Without Guidance| :x: |
| Basic Code Generation | :white_check_mark: |
| Create Simple Web Server | :x: |
Memory
| Task | Results |
|--------------------------------------------|--------------------|
| Basic Memory | :white_check_mark: |
| Remember Multiple Ids | :x: |
| Remember Multiple Ids With Noise | :x: |
| Remember Multiple Phrases With Noise | :x: |
### gpt-engineer
Interface
| Task | Results |
|-------------|--------------------|
| Write File | :white_check_mark: |
| Read File | :white_check_mark: |
| Search File | :x: |
Code
| Task | Results |
|-----------------------------------|----------------------|
| Debug Simple Typo With Guidance | :x: |