Large scale training; Dropout; CNN; Transformer

Improving compute efficacy frontiers with SliceOut

We introduce a dropout-inspired scheme to train large neural networks faster with no loss in accuracy.

Pascal Notin, Aidan N. Gomez, Joanna Yoo, Yarin Gal