aljaz/DALLE2-pytorch
1
1
Fork 0
mirror of https://github.com/lucidrains/DALLE2-pytorch.git synced 2025-12-20 02:04:19 +01:00
Code Issues Packages Projects Releases Wiki Activity

Add a dataloader for training the decoder (#57)

Browse Source 
* Added dataloader and updated requirements

* Added option to set embedding shard width separately from webdataset shard length.
There must be a better way to do this.

* Changed embedding loader to read using fsspec

* Moved the loader into a more compatible location

* Removed unnecessary package

* Fixed typo (Embeding -> Embedding)

* Simplified example embedding finder code to remove unnecessary get_file_list function

* Added example usage of ImageEmbeddingDataset

* Changed the name of create_dataloader to be more verbose
Added a dataloaders __init__.py
This commit is contained in:
Aidan Dempster
2022-05-05 10:08:45 -04:00
committed by GitHub
parent 896f19786d
commit 15acc03bd4
4 changed files with 216 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
dalle2_pytorch/dataloaders/__init__.py Normal file
View File

@@ -0,0 +1 @@
from dalle2_pytorch.dataloaders.decoder_loader import ImageEmbeddingDataset, create_image_embedding_dataloader