dataIntroduced by Natural Instructions · 2021
Crowdsourced instruction datasets
Collections of tasks paired with human-written instructions, used to train and test instruction following.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that Natural Instructions cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Learn a reward model from human comparisons, then optimise the LM against it.