training techniqueIntroduced by Inception v3 · 2015
Label smoothing
Soften one-hot targets to regularise the classifier.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that Inception v3 cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Normalise activations per mini-batch to stabilise and speed up training.
Learnable leaky ReLUs plus an initialisation that lets very deep rectifier nets train from scratch.
Papers using this
No other paper in this dataset is tagged with it yet.