Commit Graph

670 Commits

Author SHA1 Message Date
Maiko Bossuyt
4c30b47bbc Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 20:40:41 +02:00
Maiko Bossuyt
2afc89a1a4 Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 20:40:11 +02:00
Richard Beales
0528aacfb7 Merge pull request #827 from PierreBastiani/user_input-quality_of_life
check for authorise 'y' without trailing space
2023-04-12 19:36:58 +01:00
Richard Beales
bc75c74eef Merge pull request #957 from cryptidv/master
Adds a '--use-memory' flag to choose memory backend at runtime
2023-04-12 19:33:30 +01:00
Richard Beales
5bb77a8751 Merge pull request #794 from crimson-knight/add-documentation-for-caching-types
Adds information on how to use the other cache methods available
2023-04-12 19:31:23 +01:00
Seth T
d24c4af37d Merge branch 'master' into add-documentation-for-caching-types 2023-04-12 14:27:07 -04:00
Maiko Bossuyt
280647ff38 Update data_ingestion.py
move the search_file function inside the data_ingestion script
add memory initialisation argument
add overlap argument
add chunk max_length argument
2023-04-12 20:19:36 +02:00
Maiko Bossuyt
4465486ea3 Update file_operations.py
move the search_file function inside the data_ingestion script
2023-04-12 20:19:27 +02:00
Richard Beales
f9d8f728fa Merge pull request #981 from fabricehong/feat_log-activity-and-error-in-files-3
logging activity and error in log files in addition to the console - attempt 2
2023-04-12 19:14:05 +01:00
Fabrice Hong
9f8b9db7bb fix(global): fix wrong calls 2023-04-12 20:08:47 +02:00
Fabrice Hong
0f3c85335c fix(logger): fix file handler not outputing DEBUG 2023-04-12 19:57:22 +02:00
Fabrice Hong
158c576a87 refactor(logger): rename the typewriter log function from 'log' to 'typewriter_log' 2023-04-12 19:57:17 +02:00
Fabrice Hong
862d44ea39 fix(logger): fix typewriter simulation doesn't work well with Typing spinner 2023-04-12 19:54:03 +02:00
Maiko Bossuyt
8faa6ef949 Create data_ingestion.py
This script is use when we want to seed Auto-GPT memory with one or multiple documents.

The document are read, split into chunks and store in the memory.
2023-04-12 19:47:51 +02:00
Maiko Bossuyt
c91117616f Update file_operations.py
revert change in import as we don't need them
2023-04-12 19:46:58 +02:00
Maiko Bossuyt
7975c184a5 Update .gitignore
add new log file to gitignore
2023-04-12 19:46:39 +02:00
Fabrice Hong
1f5049a9c4 doc(logger): added class documentation 2023-04-12 19:41:11 +02:00
Fabrice Hong
43c006d71c feat(global): errors logs are logged as debug level and activated with program argument 'debug' 2023-04-12 19:41:08 +02:00
Maiko Bossuyt
137751f95c Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 19:36:40 +02:00
Richard Beales
0e004f5c14 Merge pull request #697 from Wladastic/fix-user-feedback-json-error
fix json parser
2023-04-12 18:22:47 +01:00
Richard Beales
0270696616 Merge pull request #865 from drikusroor/add-unit-tests-workflow
Add unit tests workflow
2023-04-12 18:15:40 +01:00
Richard Beales
364e2a4ba1 Merge branch 'master' into add-unit-tests-workflow 2023-04-12 18:14:37 +01:00
Maiko Bossuyt
d7609b3095 Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 19:13:26 +02:00
Maiko Bossuyt
0dddc94bda Add file ingestion methode in file_operations.py
Add the following functions to ingest data into memory before Auto-GPT run.

- split_file: given a content, split it in chunks of max_length with (or without) a specified overlap

- ingest_file: read a file, use split_file to split it in chunks and load each chunk in memory

- ingest_directory: ingest all files in a directory in memory
2023-04-12 19:13:04 +02:00
Richard Beales
9c9758c720 Merge pull request #700 from Rokniel/azure-deployment-additions
Add required env parameters for azure usage
2023-04-12 18:08:54 +01:00
Richard Beales
c98471e333 Merge pull request #685 from STRML/fix/json-parsing
Fix various JSON input bugs
2023-04-12 18:03:34 +01:00
Richard Beales
a7176cd229 Merge pull request #215 from slavakurilyak/security-and-robustness-improvements
Improve Security and Robustness in browse.py
2023-04-12 17:37:44 +01:00
Samuel Reed
434f27fb51 Fix various JSON input bugs in correction
By not having correct_json(json_str) in the try/except,
it was still easily possible to throw Invalid JSON errors.

When responses were received with no JSON at all, parsing
would fail on attempting to locate the braces.
2023-04-12 10:34:33 -04:00
Eesa Hamza
ec6918ab48 Added some comments 2023-04-12 16:59:50 +03:00
Eesa Hamza
083ccb6bd3 Added a memory backend argument 2023-04-12 16:58:39 +03:00
Wlad
0105dd340a Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-12 15:01:24 +02:00
sarango
16b37fff1d Fix to LocalCache add method, created integration test for it 2023-04-12 21:49:23 +12:00
Richard Beales
ae6adb4ade Merge pull request #770 from honeykjoule/update-gitignore
update gitignore venv/* to *venv/*
2023-04-12 10:12:15 +01:00
Richard Beales
3f693b9234 Merge pull request #752 from josephbisaillon/patch-3
Add OpenAPI Key Link to README
2023-04-12 10:11:16 +01:00
Manal Arora
94441ee63b correcting the clone command in contributing.md (#927)
* correcting the clone command in contributing.md

* removing extra newlines added in previous commit

removing extra newlines added in previous commit
2023-04-12 10:07:50 +01:00
Richard Beales
3ea57ca326 Merge pull request #888 from chozzz/bugfix
Bugfix for #803 - Debug mode
2023-04-12 10:06:04 +01:00
Wlad
c6605b06c5 Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-12 10:58:09 +02:00
Wlad
4063483b87 add my fixes 2023-04-12 10:56:54 +02:00
Richard Beales
9558f7a6c0 Merge pull request #746 from blankster/patch-3
Update .gitignore to ignore potential .idea folder
2023-04-12 09:56:44 +01:00
Richard Beales
4dbf72159d Merge pull request #542 from ccheney/attr-error-lower
command_name null check before calling .lower()
2023-04-12 09:54:05 +01:00
Richard Beales
a0cebb02db Merge pull request #733 from keenborder786/gpt_4_only_option
GPT-4 Only Option
2023-04-12 09:36:45 +01:00
Richard Beales
56ed3eed9b Merge pull request #871 from Legionof7/typofix
Changed spelling from "GTP" to "GPT". Also removed the 3 as this can run on GPT4.
2023-04-12 09:25:43 +01:00
Drikus Roor
5265d81754 docs: Prepare unit test workflow status badge for Torantulino's repository 2023-04-12 10:16:42 +02:00
Drikus Roor
0e5271b62a ci: Set continue on error to false 2023-04-12 10:16:42 +02:00
Drikus Roor
d8f9d1df98 fix: Fix json_parsers tests 2023-04-12 10:16:42 +02:00
Drikus Roor
ed120c3a39 fix: Fix browse scrape test 2023-04-12 10:16:42 +02:00
Drikus Roor
b3c23ee0d3 chore: Rename workflow to "Unit Tests" 2023-04-12 10:16:42 +02:00
Drikus Roor
0adc4239b7 ci: Calculate coverage only over scripts folder 2023-04-12 10:16:42 +02:00
Drikus Roor
331597eb0e docs: Add badge of unit tests status 2023-04-12 10:16:42 +02:00
Drikus Roor
bcdf948e55 docs: Update README.md about running tests and coverage 2023-04-12 10:16:42 +02:00