Paper Lineage
Esc
training techniqueIntroduced by PReLU / He init · 2015

PReLU & He initialisation

Learnable leaky ReLUs plus an initialisation that lets very deep rectifier nets train from scratch.

Drafted by AI · not yet reviewed

How this idea evolved

No earlier ideas recorded for this concept yet.

Papers using this

No other paper in this dataset is tagged with it yet.