aljaz/Auto-GPT
1
0
Fork 0
mirror of https://github.com/aljazceru/Auto-GPT.git synced 2025-12-21 16:04:21 +01:00
Code Issues Packages Projects Releases Wiki Activity

fix chunk creation

Browse Source 
the last chunk wasn't correctly created, this commit fix that issue.
This commit is contained in:
Maiko Bossuyt
2023-04-12 22:46:49 +02:00
parent 65cc4f833f
commit 2e0b44ae05
1 changed files with 5 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
scripts/file_operations.py
View File

@@ -38,11 +38,12 @@ def split_file(content, max_length=4000, overlap=0):
chunk = content[start:end] chunk = content[start:end]
yield chunk yield chunk
start += max_length - overlap start += max_length - overlap
if start + max_length - overlap >= content_length: if start + max_length > content_length:
break
if end + overlap > content_length:
start = content_length - max_length start = content_length - max_length
end = content_length
chunk = content[start:end]
yield chunk
break
def read_file(filename): def read_file(filename):
"""Read a file and return the contents""" """Read a file and return the contents"""