dataIntroduced by GNMT · 2016
WordPiece subword tokens
Split rare words into frequent sub-word pieces so the vocabulary stays small and open.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that GNMT cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Encode an input sequence, then decode an output sequence from it.
Papers using this
- 2018SentencePiece
- 2019UniLM
- 2019Unicoder-VL
- 2019LXMERT
- 2019VL-BERT
- 2021VLMo