Phil Wang 6e27f617f1 use t5 relative positional bias in prior network causal transformer, since it makes more sense than rotary embeddings

2022-04-14 12:01:09 -07:00

..

data

bring in the simple tokenizer released by openai, but also plan on leaving room for custom tokenizer with yttm

2022-04-12 09:23:17 -07:00

__init__.py

fix everything and make sure it runs end to end, document everything in readme for public

2022-04-13 18:05:25 -07:00

cli.py

create the eventual dream cli, like bigsleep library

2022-04-12 10:04:17 -07:00

dalle2_pytorch.py

use t5 relative positional bias in prior network causal transformer, since it makes more sense than rotary embeddings

2022-04-14 12:01:09 -07:00

tokenizer.py

bring in the simple tokenizer released by openai, but also plan on leaving room for custom tokenizer with yttm

2022-04-12 09:23:17 -07:00

train.py

get ready for all the training related classes and functions

2022-04-12 09:54:50 -07:00