Phil Wang c9377efc93 go for the multi-headed queries, one-headed key/values, proven out in AlphaCode as well as PaLM by now

2022-04-13 12:01:43 -07:00

..

data

bring in the simple tokenizer released by openai, but also plan on leaving room for custom tokenizer with yttm

2022-04-12 09:23:17 -07:00

__init__.py

scaffold

2022-04-07 07:29:34 -07:00

cli.py

create the eventual dream cli, like bigsleep library

2022-04-12 10:04:17 -07:00

dalle2_pytorch.py

go for the multi-headed queries, one-headed key/values, proven out in AlphaCode as well as PaLM by now

2022-04-13 12:01:43 -07:00

tokenizer.py

bring in the simple tokenizer released by openai, but also plan on leaving room for custom tokenizer with yttm

2022-04-12 09:23:17 -07:00

train.py

get ready for all the training related classes and functions

2022-04-12 09:54:50 -07:00