training techniqueIntroduced by BatchNorm · 2015
Batch normalisation
Normalise activations per mini-batch to stabilise and speed up training.
Drafted by AI · not yet reviewed
How this idea evolved
No earlier ideas recorded for this concept yet.
Papers using this
- 2015ResNet
- 2016ResNeXt
- 2017Goyal large-batch SGD
- 2017JFT-300M (unreasonable effectiveness)
- 2018Instagram hashtag pre-training
- 2019Billion-scale semi-supervised
- 2019EfficientNet
- 2019MoCo
- 2020SimCLR
- 2020BYOL