architectureIntroduced by DALL·E · 2021
Autoregressive text-to-image Transformer
Model text and image tokens as one stream and sample images from text.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that DALL·E cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Compress images into a vocabulary of discrete codes so Transformers can model them like text.
Papers using this
- 2021BEiT
- 2021ViT-VQGAN
- 2021LAION-400M
- 2022BEiT v2