architectureIntroduced by Neural Baby Talk · 2018
Template-and-slot grounded captioning
Generate a sentence template whose slots are filled by detected objects.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that Neural Baby Talk cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Force chosen tag words into generated captions at test time, without retraining.
Align image regions with sentence fragments, then generate descriptions with a multimodal RNN.
Score a caption by its TF-IDF n-gram agreement with many human references.
Papers using this
- 2018nocaps