1
Tranception: Protein Fitness Prediction with Autoregressive Transformers and Inference-time Retrieval
Tranception combines large autoregressive transformers with inference-time retrieval to achieve SOTA performance on protein fitness …
RITA: a Study on Scaling Up Generative Protein Sequence Models
We introduce RITA, a suite of autoregressive generative models for protein sequences, with up to 1.2 billion parameters
Improving black-box optimization in VAE latent space using decoder uncertainty
We use the epistemic uncertainty of the VAE decoder to guide the optimization of properties of high-dimensional structured objects …
Viral Evolution and Antibody Escape Mutations using Deep Generative Models
We leverage deep generative models of evolutionary sequences to predict viral escape mutations.
Principled Uncertainty Estimation for High Dimensional Data
We introduce an importance sampling-based estimator to estimate the epistemic uncertainty of deep learning models for high-dimensional …