From 7de965ab3fa77c724458512053993ce16c3d600f Mon Sep 17 00:00:00 2001 From: merwanehamadi Date: Fri, 14 Jul 2023 18:04:35 -0700 Subject: [PATCH] Show Auto-GPT results (#102) --- README.md | 36 +++++++++++++++++++++++++++++++++++- agent/Auto-GPT | 2 +- 2 files changed, 36 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index e73f3989..fa06317c 100644 --- a/README.md +++ b/README.md @@ -9,10 +9,44 @@ Spider chart for each agent coming soon ! :warning: These results are constantly evolving at the moment. We will publish an official benchmark result very soon. ### Auto-GPT -Coming Soon! +Interface + +| Task | Results | +|--------------|---------------------| +| Write File | :white_check_mark: | +| Read File | :white_check_mark: | +| Search File | :x: | + +Code + +| Task | Results | +|-----------------------------------|----------------------| +| Debug Simple Typo With Guidance | :x: | +| Debug Simple Typo Without Guidance| :x: | +| Basic Code Generation | :white_check_mark: | +| Create Simple Web Server | :x: | + +Memory + +| Task | Results | +|--------------------------------------------|--------------------| +| Basic Memory | :white_check_mark: | +| Remember Multiple Ids | :x: | +| Remember Multiple Ids With Noise | :x: | +| Remember Multiple Phrases With Noise | :x: | ### gpt-engineer +Interface + +| Task | Results | +|-------------|--------------------| +| Write File | :white_check_mark: | +| Read File | :white_check_mark: | +| Search File | :x: | + +Code + | Task | Results | |-----------------------------------|----------------------| | Debug Simple Typo With Guidance | :x: | diff --git a/agent/Auto-GPT b/agent/Auto-GPT index d4fc134f..9079f664 160000 --- a/agent/Auto-GPT +++ b/agent/Auto-GPT @@ -1 +1 @@ -Subproject commit d4fc134f8c4bd7b63f283f932f68932317f53f78 +Subproject commit 9079f66417f2480d0f5764fb0f916d3241b3fae8