From b093f921828c3857aaba238b087506cd710c1f1f Mon Sep 17 00:00:00 2001 From: Phil Wang Date: Wed, 27 Apr 2022 08:25:16 -0700 Subject: [PATCH] inform what is possible --- README.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 3637dd8..91efc4a 100644 --- a/README.md +++ b/README.md @@ -499,10 +499,12 @@ loss.backward() ### DALL-E2 with Latent Diffusion -This repository decides to take the next step and offer DALL-E2 combined with latent diffusion, from Rombach et al. +This repository decides to take the next step and offer DALL-E v2 combined with latent diffusion, from Rombach et al. You can use it as follows. Latent diffusion can be limited to just the first U-Net in the cascade, or to any number you wish. +The repository also comes equipped with all the necessary settings to recreate `ViT-VQGan` from the Improved VQGans paper. Furthermore, the vector quantization library also comes equipped to do residual or multi-headed quantization, which I believe will give an even further boost in performance to the autoencoder. + ```python import torch from dalle2_pytorch import Unet, Decoder, CLIP, VQGanVAE