Commit Graph

693 Commits

Author SHA1 Message Date
Maiko Bossuyt
2f1181f9a1 Update .gitignore 2023-04-12 22:52:37 +02:00
Maiko Bossuyt
2c8b42307b Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 22:52:08 +02:00
Maiko Bossuyt
4e914e5ec1 Revert "Update .gitignore"
This reverts commit 7975c184a5.
2023-04-12 22:51:52 +02:00
Maiko Bossuyt
2e0b44ae05 fix chunk creation
the last chunk wasn't correctly created, this commit fix that issue.
2023-04-12 22:46:49 +02:00
Richard Beales
a0f900f2da Merge pull request #1007 from drikusroor/fix-flake8-issues
Fix flake8 issues
2023-04-12 21:43:35 +01:00
Drikus Roor
639df44865 docs: Update README.md with the flake8 command used in the CI 2023-04-12 22:42:15 +02:00
Drikus Roor
f4a481513d ci: Set continue-on-error to false for flake8 lint job 2023-04-12 22:13:02 +02:00
Drikus Roor
1f837968ff fix: Fix flake8 errors based on the flake8 command with a narrower definition of errors 2023-04-12 22:12:25 +02:00
Drikus Roor
8d0d4135ea ci: Update flake8 command to ignore some issues.
We can later gradually make it stricter until we have no errors anymore.
2023-04-12 22:07:04 +02:00
Pi
5982f29c18 Merge pull request #1002 from Torantulino/(workflow)IssueTemplate-for-bug
Update github-issue template for bug-report
2023-04-12 20:31:05 +01:00
Pi
b5c71a1b8e Update 1.bug.yml 2023-04-12 20:21:06 +01:00
Richard Beales
7e3ff66494 Merge pull request #913 from chozzz/bugfix-823
Bugfix for #840 - Local memory fix
2023-04-12 20:07:50 +01:00
Richard Beales
079daf726d Merge pull request #923 from drikusroor/add-flake8-workflow
Add flake8 linter workflow
2023-04-12 19:48:24 +01:00
Maiko Bossuyt
65cc4f833f Add Memory Pre-Seeding information to readme.md
Add the documentation for memory pre-seeding
2023-04-12 20:47:46 +02:00
Richard Beales
ac76a97ec1 Merge pull request #798 from KissPeter/improve_Dockerfile_to_make_it_smaller
Improve Dockerfile
2023-04-12 19:44:58 +01:00
Maiko Bossuyt
4c30b47bbc Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 20:40:41 +02:00
Maiko Bossuyt
2afc89a1a4 Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 20:40:11 +02:00
Richard Beales
0528aacfb7 Merge pull request #827 from PierreBastiani/user_input-quality_of_life
check for authorise 'y' without trailing space
2023-04-12 19:36:58 +01:00
Richard Beales
bc75c74eef Merge pull request #957 from cryptidv/master
Adds a '--use-memory' flag to choose memory backend at runtime
2023-04-12 19:33:30 +01:00
Richard Beales
5bb77a8751 Merge pull request #794 from crimson-knight/add-documentation-for-caching-types
Adds information on how to use the other cache methods available
2023-04-12 19:31:23 +01:00
Seth T
d24c4af37d Merge branch 'master' into add-documentation-for-caching-types 2023-04-12 14:27:07 -04:00
Drikus Roor
d780988554 chore: Add new lines to end of files 2023-04-12 20:21:42 +02:00
Drikus Roor
29d6ecd4d3 ci: Allow flake8 failure since there are a lot of issues 2023-04-12 20:21:42 +02:00
Drikus Roor
76cc0d2d74 docs: Document flake8 linter 2023-04-12 20:21:42 +02:00
Drikus Roor
87d465a8f1 chore: Rename unit test workflow file to ci.yml 2023-04-12 20:21:42 +02:00
Drikus Roor
dc0a94bba3 ci: Add a flake8 linting job 2023-04-12 20:21:42 +02:00
Drikus Roor
fa5b71c022 docs: Update README.md about running tests and coverage 2023-04-12 20:21:42 +02:00
Maiko Bossuyt
280647ff38 Update data_ingestion.py
move the search_file function inside the data_ingestion script
add memory initialisation argument
add overlap argument
add chunk max_length argument
2023-04-12 20:19:36 +02:00
Maiko Bossuyt
4465486ea3 Update file_operations.py
move the search_file function inside the data_ingestion script
2023-04-12 20:19:27 +02:00
Richard Beales
f9d8f728fa Merge pull request #981 from fabricehong/feat_log-activity-and-error-in-files-3
logging activity and error in log files in addition to the console - attempt 2
2023-04-12 19:14:05 +01:00
Fabrice Hong
9f8b9db7bb fix(global): fix wrong calls 2023-04-12 20:08:47 +02:00
Fabrice Hong
0f3c85335c fix(logger): fix file handler not outputing DEBUG 2023-04-12 19:57:22 +02:00
Fabrice Hong
158c576a87 refactor(logger): rename the typewriter log function from 'log' to 'typewriter_log' 2023-04-12 19:57:17 +02:00
Fabrice Hong
862d44ea39 fix(logger): fix typewriter simulation doesn't work well with Typing spinner 2023-04-12 19:54:03 +02:00
Maiko Bossuyt
8faa6ef949 Create data_ingestion.py
This script is use when we want to seed Auto-GPT memory with one or multiple documents.

The document are read, split into chunks and store in the memory.
2023-04-12 19:47:51 +02:00
Maiko Bossuyt
c91117616f Update file_operations.py
revert change in import as we don't need them
2023-04-12 19:46:58 +02:00
Maiko Bossuyt
7975c184a5 Update .gitignore
add new log file to gitignore
2023-04-12 19:46:39 +02:00
Fabrice Hong
1f5049a9c4 doc(logger): added class documentation 2023-04-12 19:41:11 +02:00
Fabrice Hong
43c006d71c feat(global): errors logs are logged as debug level and activated with program argument 'debug' 2023-04-12 19:41:08 +02:00
Maiko Bossuyt
137751f95c Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 19:36:40 +02:00
Richard Beales
0e004f5c14 Merge pull request #697 from Wladastic/fix-user-feedback-json-error
fix json parser
2023-04-12 18:22:47 +01:00
Richard Beales
0270696616 Merge pull request #865 from drikusroor/add-unit-tests-workflow
Add unit tests workflow
2023-04-12 18:15:40 +01:00
Richard Beales
364e2a4ba1 Merge branch 'master' into add-unit-tests-workflow 2023-04-12 18:14:37 +01:00
Maiko Bossuyt
d7609b3095 Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 19:13:26 +02:00
Maiko Bossuyt
0dddc94bda Add file ingestion methode in file_operations.py
Add the following functions to ingest data into memory before Auto-GPT run.

- split_file: given a content, split it in chunks of max_length with (or without) a specified overlap

- ingest_file: read a file, use split_file to split it in chunks and load each chunk in memory

- ingest_directory: ingest all files in a directory in memory
2023-04-12 19:13:04 +02:00
Richard Beales
9c9758c720 Merge pull request #700 from Rokniel/azure-deployment-additions
Add required env parameters for azure usage
2023-04-12 18:08:54 +01:00
Richard Beales
c98471e333 Merge pull request #685 from STRML/fix/json-parsing
Fix various JSON input bugs
2023-04-12 18:03:34 +01:00
Richard Beales
a7176cd229 Merge pull request #215 from slavakurilyak/security-and-robustness-improvements
Improve Security and Robustness in browse.py
2023-04-12 17:37:44 +01:00
Samuel Reed
434f27fb51 Fix various JSON input bugs in correction
By not having correct_json(json_str) in the try/except,
it was still easily possible to throw Invalid JSON errors.

When responses were received with no JSON at all, parsing
would fail on attempting to locate the braces.
2023-04-12 10:34:33 -04:00
Eesa Hamza
ec6918ab48 Added some comments 2023-04-12 16:59:50 +03:00