Jun 1, 20261 min read
Protein Language Models
Current research on faster training, scaling behavior, and mechanistic interpretability of protein language models.
I am interested in how biological structure is represented inside sequence models and how these representations change with scale.