training techniqueIntroduced by Constrained beam search captioning · 2016
Constrained beam search
Force chosen tag words into generated captions at test time, without retraining.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that Constrained beam search captioning cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Align image regions with sentence fragments, then generate descriptions with a multimodal RNN.
Detect caption words with multiple-instance learning, then compose sentences with an LM.
Score a caption by its TF-IDF n-gram agreement with many human references.
Papers using this
- 2018nocaps