training techniqueIntroduced by LiT · 2021
Locked image tuning
Keep a pretrained image tower frozen and train only the text side contrastively.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that LiT cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Classify into unseen classes by comparing an image with text descriptions of them.
Skip expensive cleaning: a billion noisy alt-text pairs beat curated datasets.
Pull matching image and text embeddings together and push mismatched pairs apart.