objectiveIntroduced by T5 · 2019
Text-to-text framing
Cast every task as text in, text out: one model, one loss.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that T5 cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Cast ten NLP tasks as QA over a context so one model handles them all.
Papers using this
- 2020Knowledge in LM parameters
- 2020GLU variants
- 2020Learning to summarize from human feedbac
- 2020MMLU
- 2021Prefix-Tuning
- 2021Switch Transformer
- 2021VL-T5
- 2021Conceptual 12M
- 2021Prompt tuning
- 2021SimVLM
- 2021Recursive book summarization
- 2021T0
- 2021Gopher
- 2022LaMDA
- 2022PaLM
- 2022GPT-NeoX-20B
- 2022Super-NaturalInstructions
- 2022CoCa
- 2022Flan-T5 / Flan-PaLM