Transformer; Protein; Retrieval; Fitness prediction
TranceptEVE: Combining Family-specific and Family-agnostic Models of Protein Sequences for Improved Fitness Prediction
NeurIPS, LMRL, 2022. A hybrid family-specific and family-agnostic model to achieve SOTA performance on protein fitness prediction and human variant annotation.
Tranception: Protein Fitness Prediction with Autoregressive Transformers and Inference-time Retrieval
ICML, 2022. A suite of autoregressive transformers with biological priors, augmented with inference-time retrieval, to achieve SOTA performance on protein fitness prediction.