A collection of my ideas, projects, and publications that worked.
6 of 6 posts
Current research on faster training, scaling behavior, and mechanistic interpretability of protein language models.
A research direction on statistical physics models for language and large language models.
Senior thesis with Prof. Elad Hazan on scaling laws for large language models.
Work on efficient Spectral Transform Units for long-context sequence modeling.
Junior thesis with Prof. Robert Tarjan on approximate nearest neighbor search and hierarchical vector retrieval algorithms.
Research with Prof. A. Nihat Berker on first-order to second-order phase transition changeover and latent heats of q-state Potts models in two and three dimensions.
