Phil Wang 83aabd42ca move epsilon inside of square root for further stability in rmsnorm ...

improvise and use rmsnorm in convnext blocks too

2022-04-12 11:18:36 -07:00

..

data

bring in the simple tokenizer released by openai, but also plan on leaving room for custom tokenizer with yttm

2022-04-12 09:23:17 -07:00

__init__.py

scaffold

2022-04-07 07:29:34 -07:00

cli.py

create the eventual dream cli, like bigsleep library

2022-04-12 10:04:17 -07:00

dalle2_pytorch.py

move epsilon inside of square root for further stability in rmsnorm

2022-04-12 11:18:36 -07:00

tokenizer.py

bring in the simple tokenizer released by openai, but also plan on leaving room for custom tokenizer with yttm

2022-04-12 09:23:17 -07:00

train.py

get ready for all the training related classes and functions

2022-04-12 09:54:50 -07:00