architectureIntroduced by Frozen · 2021
Visual prefix for a frozen LM
Turn an image into a few embeddings that a frozen LM reads as if they were words.
Drafted by AI · not yet reviewed
How this idea evolved
Each step is the idea’s introducing paper. The line between steps is the citation link between those papers.
- 2021
Optimise a few continuous 'virtual tokens' prepended at every layer of a frozen LM.
Cites · not yet reviewedcited 4× · §The Frozen Method“Frozen is a method for grounding a large language model without changing its weights, closely related to prefix tuning [22, 19].”
From Frozen · §The Frozen Method - 2021
Turn an image into a few embeddings that a frozen LM reads as if they were words.
Papers using this
- 2021Prefix-Tuning
- 2021Prompt tuning
- 2021SimVLM
- 2022VL-BEiT