mirror of
https://github.com/aljazceru/Auto-GPT.git
synced 2026-01-07 08:14:25 +01:00
31525dfef7
* adding requiered packages for loading pdf, docx, md, tex files (preferably pure python packages) * adding text file utils providing function to load file based on extension && adding read_text_file command * adding test cases for text file loading (pdf file creation is hardcoded due to external package requierment for creation (a sample file can be added)) * formatting * changing command name from 'read_text_file' to 'parse_text_document' * fallback to txtParser if file extension is not known to read script and code files * adding extension respective parsers * adding binary file check function * adding file existance check && raising valueError for unsupported binary file formats * adding check file type (binary) in test_parsers for specific extensions && fixing mock pdf generation to include null bytes * adding .yml extension parser * removal of .doc parser * updating file loading commands names * updating test (removing .doc mock function) * fix: import sort * new cassette for mem A * feat: update Cassettes * feat: consolidate commands * feat: linting * feat: updates to cassettes --------- Co-authored-by: Reinier van der Leer <github@pwuts.nl> Co-authored-by: Nicholas Tindle <nick@ntindle.com> Co-authored-by: k-boikov <64261260+k-boikov@users.noreply.github.com>
61 lines
1.0 KiB
Plaintext
61 lines
1.0 KiB
Plaintext
beautifulsoup4>=4.12.2
|
|
colorama==0.4.6
|
|
distro==1.8.0
|
|
openai==0.27.2
|
|
playsound==1.2.2
|
|
python-dotenv==1.0.0
|
|
pyyaml==6.0
|
|
PyPDF2
|
|
python-docx
|
|
markdown
|
|
pylatexenc
|
|
readability-lxml==0.8.1
|
|
requests
|
|
tiktoken==0.3.3
|
|
gTTS==2.3.1
|
|
docker
|
|
duckduckgo-search>=2.9.5
|
|
google-api-python-client #(https://developers.google.com/custom-search/v1/overview)
|
|
pinecone-client==2.2.1
|
|
redis
|
|
orjson==3.8.10
|
|
Pillow
|
|
selenium==4.1.4
|
|
webdriver-manager
|
|
jsonschema
|
|
tweepy
|
|
click
|
|
charset-normalizer>=3.1.0
|
|
spacy>=3.0.0,<4.0.0
|
|
en-core-web-sm @ https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.5.0/en_core_web_sm-3.5.0-py3-none-any.whl
|
|
|
|
##Dev
|
|
coverage
|
|
flake8
|
|
numpy
|
|
pre-commit
|
|
black
|
|
isort
|
|
gitpython==3.1.31
|
|
auto-gpt-plugin-template
|
|
mkdocs
|
|
pymdown-extensions
|
|
mypy
|
|
|
|
# OpenAI and Generic plugins import
|
|
openapi-python-client==0.13.4
|
|
|
|
# Items below this point will not be included in the Docker Image
|
|
|
|
# Testing dependencies
|
|
pytest
|
|
asynctest
|
|
pytest-asyncio
|
|
pytest-benchmark
|
|
pytest-cov
|
|
pytest-integration
|
|
pytest-mock
|
|
vcrpy
|
|
pytest-recording
|
|
pytest-xdist
|