Phil Wang
3df86acc8b
make it work for @ethancohen123
2022-08-19 11:25:34 -07:00
Phil Wang
27f19ba7fa
make sure diffusion prior trainer can operate with no warmup
2022-08-15 14:27:40 -07:00
Phil Wang
8f38339c2b
give diffusion prior trainer cosine annealing lr too
2022-08-15 07:38:01 -07:00
Phil Wang
6b9b4b9e5e
add cosine annealing lr schedule
2022-08-15 07:29:56 -07:00
Phil Wang
44e09d5a4d
add weight standardization behind feature flag, which may potentially work well with group norm
2022-08-14 11:34:45 -07:00
Phil Wang
34806663e3
make it so diffusion prior p_sample_loop returns unnormalized image embeddings
2022-08-13 10:03:40 -07:00
Phil Wang
dc816b1b6e
dry up some code around handling unet outputs with learned variance
2022-08-12 15:25:03 -07:00
Phil Wang
05192ffac4
fix self conditioning shape in diffusion prior
2022-08-12 12:30:03 -07:00
Phil Wang
9440411954
make self conditioning technique work with diffusion prior
2022-08-12 12:20:51 -07:00
Phil Wang
981d407792
comment
2022-08-12 11:41:23 -07:00
Phil Wang
7c5477b26d
bet on the new self-conditioning technique out of geoffrey hintons group
2022-08-12 11:36:08 -07:00
Phil Wang
be3bb868bf
add gradient checkpointing for all resnet blocks
2022-08-02 19:21:44 -07:00
Phil Wang
451de34871
enforce clip anytorch version
2022-07-30 10:07:55 -07:00
Phil Wang
f22e8c8741
make open clip available for use with dalle2 pytorch
2022-07-30 09:02:31 -07:00
Phil Wang
87432e93ad
quick fix for linear attention
2022-07-29 13:17:12 -07:00
Phil Wang
d167378401
add cosine sim for self attention as well, as a setting
2022-07-29 12:48:20 -07:00
Phil Wang
2d67d5821e
change up epsilon in layernorm the case of using fp16, thanks to @Veldrovive for figuring out this stabilizes training
2022-07-29 12:41:02 -07:00
Phil Wang
748c7fe7af
allow for cosine sim cross attention, modify linear attention in attempt to resolve issue on fp16
2022-07-29 11:12:18 -07:00
Phil Wang
80046334ad
make sure entire readme runs without errors
2022-07-28 10:17:43 -07:00
Phil Wang
36fb46a95e
fix readme and a small bug in DALLE2 class
2022-07-28 08:33:51 -07:00
Phil Wang
07abfcf45b
rescale values in linear attention to mitigate overflows in fp16 setting
2022-07-27 12:27:38 -07:00
Phil Wang
406e75043f
add upsample combiner feature for the unets
2022-07-26 10:46:04 -07:00
Phil Wang
9646dfc0e6
fix path_or_state bug
2022-07-26 09:47:54 -07:00
Phil Wang
62043acb2f
fix repaint
2022-07-24 15:29:06 -07:00
Phil Wang
417ff808e6
1.0.3
2022-07-22 13:16:57 -07:00
Aidan Dempster
f3d7e226ba
Changed types to be generic instead of functions ( #215 )
...
This allows pylance to do proper type hinting and makes developing
extensions to the package much easier
2022-07-22 13:16:29 -07:00
Phil Wang
48a1302428
1.0.2
2022-07-20 23:01:51 -07:00
Aidan Dempster
ccaa46b81b
Re-introduced change that was accidentally rolled back ( #212 )
2022-07-20 23:01:19 -07:00
Phil Wang
76d08498cc
diffusion prior training updates from @nousr
2022-07-20 18:05:27 -07:00
zion
f9423d308b
Prior updates ( #211 )
...
* update configs for prior
add prior warmup to config
update example prior config
* update prior trainer & script
add deepspeed amp & warmup
adopt full accelerator support
reload at sample point
finish epoch resume code
* update tracker save method for prior
* helper functions for prior_loader
2022-07-20 18:04:26 -07:00
Phil Wang
06c65b60d2
1.0.0
2022-07-19 19:08:17 -07:00
Aidan Dempster
4145474bab
Improved upsampler training ( #181 )
...
Sampling is now possible without the first decoder unet
Non-training unets are deleted in the decoder trainer since they are never used and it is harder merge the models is they have keys in this state dict
Fixed a mistake where clip was not re-added after saving
2022-07-19 19:07:50 -07:00
Phil Wang
4b912a38c6
0.26.2
2022-07-19 17:50:36 -07:00
Aidan Dempster
f97e55ec6b
Quality of life improvements for tracker savers ( #210 )
...
The default save location is now none so if keys are not specified the
corresponding checkpoint type is not saved.
Models and checkpoints are now both saved with version number and the
config used to create them in order to simplify loading.
Documentation was fixed to be in line with current usage.
2022-07-19 17:50:18 -07:00
Phil Wang
291377bb9c
@jacobwjs reports dynamic thresholding works very well and 0.95 is a better value
2022-07-19 11:31:56 -07:00
Phil Wang
723bf0abba
complete inpainting ability using inpaint_image and inpaint_mask passed into sample function for decoder
2022-07-19 09:26:55 -07:00
Phil Wang
d88c7ba56c
fix a bug with ddim and predict x0 objective
2022-07-18 19:04:26 -07:00
Phil Wang
3676a8ce78
comments
2022-07-18 15:02:04 -07:00
Phil Wang
da8e99ada0
fix sample bug
2022-07-18 13:50:22 -07:00
Phil Wang
6afb886cf4
complete imagen-like noise level conditioning
2022-07-18 13:43:57 -07:00
Phil Wang
a2ee3fa3cc
offer way to turn off initial cross embed convolutional module, for debugging upsampler artifacts
2022-07-15 17:29:10 -07:00
Phil Wang
a58a370d75
takes care of a grad strides error at https://github.com/lucidrains/DALLE2-pytorch/issues/196 thanks to @YUHANG-Ma
2022-07-14 15:28:34 -07:00
Phil Wang
1662bbf226
protect against random cropping for base unet
2022-07-14 12:49:43 -07:00
Phil Wang
a34f60962a
let the neural network peek at the low resolution conditioning one last time before making prediction, for upsamplers
2022-07-14 10:27:04 -07:00
Phil Wang
0b40cbaa54
just always use nearest neighbor interpolation when resizing for low resolution conditioning, for https://github.com/lucidrains/DALLE2-pytorch/pull/181
2022-07-13 20:59:43 -07:00
Phil Wang
f141144a6d
allow for using classifier free guidance for some unets but not others, by passing in a tuple of cond_scale during sampling for decoder, just in case it is causing issues for upsamplers
2022-07-13 13:12:30 -07:00
Phil Wang
f988207718
hack around some inplace error, also make sure for openai clip text encoding, only tokens after eos_id is masked out
2022-07-13 12:56:02 -07:00
Phil Wang
b2073219f0
foolproof sampling for decoder to always use eval mode (and restore training state afterwards)
2022-07-13 10:21:00 -07:00
Phil Wang
cc0f7a935c
fix non pixel shuffle upsample
2022-07-13 10:16:02 -07:00
Phil Wang
95a512cb65
fix a potential bug with conditioning with blurred low resolution image, blur should be applied only 50% of the time
2022-07-13 10:11:49 -07:00
