Mar 1, 20261 min read
Physics of Language Models
A research direction on statistical physics models for language and large language models.
I am interested in whether ideas from entropy, correlations, phase transitions, and scaling can help explain language model behavior.