Phase Transitions
New preprint out — Phase Transitions in Attention, where we work out a Bayesian theory for how copy heads emerge, and find a an interesting phase diagram.
New preprint out — Phase Transitions in Attention, where we work out a Bayesian theory for how copy heads emerge, and find a an interesting phase diagram.