mirror of
https://github.com/aljazceru/gpt-engineer.git
synced 2025-12-18 13:15:00 +01:00
Update benchmarks
This commit is contained in:
@@ -4,13 +4,46 @@
|
|||||||
$ python scripts/benchmark.py
|
$ python scripts/benchmark.py
|
||||||
```
|
```
|
||||||
|
|
||||||
**file_explorer** works with unit tests config
|
| Benchmark | Ran | Works | Perfect |
|
||||||
|
|--------------------|-----|-------|---------|
|
||||||
|
| currency_converter | ❌ | ❌ | ❌ |
|
||||||
|
| image_resizer | ✅ | ❌ | ❌ |
|
||||||
|
| pomodoro_timer | ❌ | ❌ | ❌ |
|
||||||
|
| url_shortener | ❌ | ❌ | ❌ |
|
||||||
|
| file_explorer | ✅ | ✅ | ✅ |
|
||||||
|
| markdown_editor | ❌ | ❌ | ❌ |
|
||||||
|
| timer_app | ✅ | ❌ | ❌ |
|
||||||
|
| weather_app | ❌ | ❌ | ❌ |
|
||||||
|
| file_organizer | ✅ | ✅ | ✅ |
|
||||||
|
| password_generator | ✅ | ✅ | ✅ |
|
||||||
|
| todo_list | ✅ | ❌ | ❌ |
|
||||||
|
|
||||||
|
|
||||||
|
# Notes on the errors
|
||||||
|
**timer_app** almost works with unit tests config
|
||||||
|
- failure mode: undefined import/conflicting names
|
||||||
|
|
||||||
|
**file_explorer** works
|
||||||
|
|
||||||
|
**file organiser**: works
|
||||||
|
|
||||||
**image_resizer** almost works with unit tests config
|
**image_resizer** almost works with unit tests config
|
||||||
- failure mode: undefined import
|
- failure mode: undefined import
|
||||||
|
|
||||||
**timer_app** almost works with unit tests config
|
**todo_list** runs. doesn't really work with unit tests config
|
||||||
- failure mode: undefined import/conflicting names
|
Uncaught ReferenceError: module is not defined
|
||||||
|
- failure mode: placeholder text
|
||||||
|
|
||||||
**todo_list** doesn't really work with unit tests config
|
|
||||||
- failure mode: placeholder text
|
url_shortner starts but gets the error:
|
||||||
|
SQLite objects created in a thread can only be used in that same thread. The object was created in thread id 8636125824 and this is thread id 13021003776.
|
||||||
|
|
||||||
|
|
||||||
|
markdown_editor:
|
||||||
|
failing tests, 'WebDriver' object has no attribute 'find_element_by_id'
|
||||||
|
|
||||||
|
pomodoro: doesn't run it only tests
|
||||||
|
|
||||||
|
currency_converter: backend doesnt return anything
|
||||||
|
|
||||||
|
weather_app only runs test, no code existed
|
||||||
|
|||||||
Reference in New Issue
Block a user