Large scale training; Transformer; Protein

RITA: a Study on Scaling Up Generative Protein Sequence Models

RITA: a Study on Scaling Up Generative Protein Sequence Models

Daniel Hesslow, Niccoló Zanichelli, Pascal Notin, Iacopo Poli, Debora Marks
ICML, WCB, 2022. The first paper investigating scaling laws in protein language modeling.
PDF Cite Code arXiv Workshop