diff --git a/README.md b/README.md index e73f3989..fa06317c 100644 --- a/README.md +++ b/README.md @@ -9,10 +9,44 @@ Spider chart for each agent coming soon ! :warning: These results are constantly evolving at the moment. We will publish an official benchmark result very soon. ### Auto-GPT -Coming Soon! +Interface + +| Task | Results | +|--------------|---------------------| +| Write File | :white_check_mark: | +| Read File | :white_check_mark: | +| Search File | :x: | + +Code + +| Task | Results | +|-----------------------------------|----------------------| +| Debug Simple Typo With Guidance | :x: | +| Debug Simple Typo Without Guidance| :x: | +| Basic Code Generation | :white_check_mark: | +| Create Simple Web Server | :x: | + +Memory + +| Task | Results | +|--------------------------------------------|--------------------| +| Basic Memory | :white_check_mark: | +| Remember Multiple Ids | :x: | +| Remember Multiple Ids With Noise | :x: | +| Remember Multiple Phrases With Noise | :x: | ### gpt-engineer +Interface + +| Task | Results | +|-------------|--------------------| +| Write File | :white_check_mark: | +| Read File | :white_check_mark: | +| Search File | :x: | + +Code + | Task | Results | |-----------------------------------|----------------------| | Debug Simple Typo With Guidance | :x: | diff --git a/agent/Auto-GPT b/agent/Auto-GPT index d4fc134f..9079f664 160000 --- a/agent/Auto-GPT +++ b/agent/Auto-GPT @@ -1 +1 @@ -Subproject commit d4fc134f8c4bd7b63f283f932f68932317f53f78 +Subproject commit 9079f66417f2480d0f5764fb0f916d3241b3fae8