Commit Graph

91 Commits

Author SHA1 Message Date
Silen Naihin
e56b112aab i/o workspace, adding superagi (#60) 2023-07-08 03:27:31 -04:00
merwanehamadi
487f99f8f2 Use artifacts out insted of python code (#72) 2023-07-07 15:49:37 -07:00
merwanehamadi
f0f7d2be90 Fix memory challenge 2 (#71) 2023-07-07 15:38:50 -07:00
merwanehamadi
e34c83ca1c Add .txt to memory challenges (#70) 2023-07-07 15:34:57 -07:00
Erik Peterson
3defe044bd Print out all of stdout on each process poll. (#69) 2023-07-07 15:02:08 -07:00
Silen Naihin
4562bc6caf Update data.json remove text 2023-07-07 17:54:09 -04:00
merwanehamadi
e61523e59e Get rid of get file path by using the data.json convention to store the challenge information (#67)
Signed-off-by: Merwane Hamadi <merwanehamadi@gmail.com>
2023-07-07 13:58:17 -07:00
merwanehamadi
6ef32a9b1f Add "Debug code without guidance" challenge (#66)
Signed-off-by: Merwane Hamadi <merwanehamadi@gmail.com>
2023-07-07 13:55:59 -07:00
merwanehamadi
9ede17891b Add 'Debug simple typo with guidance' challenge (#65)
Signed-off-by: Merwane Hamadi <merwanehamadi@gmail.com>
2023-07-07 13:50:53 -07:00
Silen Naihin
bfd0d5c826 Fix home_path, local mini-agi run works (#64)
Co-authored-by: merwanehamadi <merwanehamadi@gmail.com>
2023-07-06 18:00:45 -07:00
merwanehamadi
0b4ae5ea78 Add 'remember phrases with noise' challenge (#63) 2023-07-06 17:19:12 -04:00
merwanehamadi
82d8f67f6a Add 'remember ids with noise' challenge (#61) 2023-07-06 01:34:51 -04:00
Silen Naihin
c76062b092 Added caching based on file key (#62)
Co-authored-by: merwanehamadi <merwanehamadi@gmail.com>
2023-07-05 21:38:01 -07:00
merwanehamadi
5b19340f8e Add 'Remember multiple ids' memory challenge (#59) 2023-07-06 00:35:15 -04:00
Silen Naihin
4ebc5aa3b3 submodule remove 2023-07-06 00:14:40 -04:00
Silen Naihin
de44d6ace5 fix 2023-07-06 00:08:49 -04:00
Silen Naihin
e6f7bcf0ae fixing --reg to --maintain workflow bug 2023-07-06 00:06:34 -04:00
merwanehamadi
7102fe1a18 Rename '--reg' flag to '--maintain' (#58) 2023-07-06 00:03:45 -04:00
merwanehamadi
74fc969dd6 Add basic memory challenge (#57) 2023-07-05 23:32:28 -04:00
Silen Naihin
bfc7dfdb29 Dynamic workspace path (#56) 2023-07-04 19:06:49 -07:00
merwanehamadi
351131bbff Change test dependencies (#55) 2023-07-04 21:45:35 -04:00
merwanehamadi
e3c453f10e Add information retrieval 3 (#54)
Co-authored-by: Silen Naihin <silen.naihin@gmail.com>
2023-07-04 20:41:13 -04:00
merwanehamadi
cef259c945 Add pr template (#52) 2023-07-04 20:34:55 -04:00
merwanehamadi
f8e550773f Add retrieval challenge test + run tests on CI pipeline (#51) 2023-07-04 18:28:00 -04:00
Silen Naihin
e6e92e9952 run in continuous 2023-07-04 14:15:04 -04:00
Silen Naihin
62d37755bc updating submodule commit 2023-07-04 14:11:38 -04:00
Silen Naihin
ed9aef5f43 adding venv to mini-agi 2023-07-04 13:51:04 -04:00
Silen Naihin
73a3e9e42d fixing mini-agi workflow 2023-07-04 13:41:54 -04:00
Silen Naihin
e25f610344 local runs, home_path config, submodule miniagi (#50) 2023-07-04 10:23:00 -07:00
merwanehamadi
7f098d5fb6 Explain how to benchmark new agents (#49) 2023-07-04 12:13:29 -04:00
merwanehamadi
f183e91ccd Integrate smol developer with agbenchmark (#48) 2023-07-03 20:28:29 -04:00
merwanehamadi
101ffdbce0 Integrate with gpt engineer (#47) 2023-07-03 14:53:28 -04:00
merwanehamadi
07133fb041 Run regression tests on push to master and stable (#46) 2023-07-03 14:42:24 -04:00
merwanehamadi
838f72097c Add static linters ci (#45) 2023-07-02 16:14:49 -04:00
merwanehamadi
2062844fa6 Integrate one challenge to auto gpt (#44) 2023-07-02 10:38:30 -04:00
merwanehamadi
0f33416b0e Merge pull request #42 from Significant-Gravitas/feat/kill
adding hook to integrate agnostically
2023-06-30 09:45:45 -07:00
Silen Naihin
7c352b745e integrate config, agent_interface just func, hook 2023-06-30 11:55:43 -04:00
Silen Naihin
2987d71264 moving run agent to tests & agnostic run working 2023-06-30 10:50:54 -04:00
Silen Naihin
fce421fb33 moving logic to benchmark.py file 2023-06-29 20:51:23 -04:00
Silen Naihin
ac5af73696 trying to get kill process 2023-06-28 21:28:46 -04:00
Silen Naihin
0c81585a53 Update README.md (#41) 2023-06-27 22:17:42 -04:00
merwanehamadi
11303e2ef7 Merge pull request #40 from Significant-Gravitas/feat/basics
addition of basic challenges, easier challenge creation, --mock flag, adding mini-agi
2023-06-27 18:50:23 -07:00
Silen Naihin
76ee994d2c read mes, remove port and host from config, etc 2023-06-27 19:19:14 -04:00
Silen Naihin
f933717d8b mini-agi, simple challenge creation, --mock flag 2023-06-27 18:17:54 -04:00
Silen Naihin
36ef54340f Merge branch 'feat/basics' of https://github.com/Significant-Gravitas/Auto-GPT-Benchmarks into feat/basics 2023-06-27 13:26:39 -04:00
Silen Naihin
fa0df12439 mini agi attempt 2023-06-27 13:26:28 -04:00
Silen Naihin
d6a6e69f2e can now put file extensions or names in files data 2023-06-27 13:26:28 -04:00
Silen Naihin
2411c35d0e update regression tests info 2023-06-27 13:26:28 -04:00
Silen Naihin
a2f79760ce other was non solution, solution is pytest-depends 2023-06-27 13:26:28 -04:00
Silen Naihin
06a6f08054 finally figured out right way to do dependencies 2023-06-27 13:26:28 -04:00