evaluationIntroduced by Kaplan scaling laws · 2020
Neural scaling laws
Loss falls as a power law in model size, data and compute.
Drafted by AI · not yet reviewed
How this idea evolved
No earlier ideas recorded for this concept yet.
Papers using this
- 2020GPT-3
- 2020The Pile
- 2022LaMDA
- 2022Chinchilla
- 2022PaLM
- 2022GPT-NeoX-20B
- 2022BIG-bench
- 2022Emergent abilities
- 2022U-PaLM