architectureIntroduced by EfficientNet · 2019
Compound model scaling
Scale depth, width and resolution together with one coefficient.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that EfficientNet cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Put measured on-device latency into the search objective.
Expand, filter with depthwise conv, then project back down to thin residual bottlenecks.
Search for a network's building block automatically instead of designing it by hand.
Papers using this
- 2019Noisy Student
- 2020Natural distribution shift robustness
- 2020ViT
- 2021CLIP
- 2021Swin