architectureIntroduced by Bilinear Attention Networks · 2018
Bilinear attention networks
Attend over all question-word × image-region pairs with low-rank bilinear pooling.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that Bilinear Attention Networks cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Pair every question with images that flip the answer, so models must actually look.
Turn existing image descriptions into question–answer training data automatically.
Answer free-form natural-language questions about an image.
Papers using this
- 2019LXMERT
- 2020X-Linear attention