RUS  ENG
Full version
SEMINARS

Seminar by I. Ya. Aref'eva "Perspective directions in quantum field theory and superstrings"
June 30, 2025 16:00, Moscow, Steklov Mathematical Institute, Room 303 (8 Gubkina)


Learning Theory as Physics

S. V. Kozyrev

Steklov Mathematical Institute of Russian Academy of Sciences, Moscow

Abstract: The following topics will be discussed:
Learning by the stochastic gradient Langevin dynamics (SGLD);
Grokking (delayed generalization) is discussed as Brownian motion;
The second law of thermodynamics and Eyring's formula of kinetics in learning;
Energetic (gradient descent) and entropic (generalization in grokking) mechanisms of chemical reaction in learning.

Language: English


© Steklov Math. Inst. of RAS, 2025