Aidan Dempster 15acc03bd4 Add a dataloader for training the decoder (#57) ...

* Added dataloader and updated requirements

* Added option to set embedding shard width separately from webdataset shard length.
There must be a better way to do this.

* Changed embedding loader to read using fsspec

* Moved the loader into a more compatible location

* Removed unnecessary package

* Fixed typo (Embeding -> Embedding)

* Simplified example embedding finder code to remove unnecessary get_file_list function

* Added example usage of ImageEmbeddingDataset

* Changed the name of create_dataloader to be more verbose
Added a dataloaders __init__.py

2022-05-05 07:08:45 -07:00

..

__init__.py

Add a dataloader for training the decoder (#57)

2022-05-05 07:08:45 -07:00

decoder_loader.py

Add a dataloader for training the decoder (#57)

2022-05-05 07:08:45 -07:00