Adaptive Lr
New preprint with Clarissa Lauditi and Cengiz Pehlevan — A Solvable Model of Adaptive Learning Rate Rescaling, where we use DMFT to study how normalized SGD accelerates training, where that acceleration breaks down at the edge of stability, and what it means for trading off width vs. batch size.