This event is organized by the Vector Institute.
Talk title:
Statistical Physics Perspective on Understanding Learning with Neural Networks
Date & Time:
Tuesday, April 1, 2025
11 a.m. - 12 p.m.
Location:
Hybrid
Speaker:
Lenka Zdeborová
Abstract:
For over four decades, statistical physics has studied exactly solvable models of artificial neural networks. In this talk, we will explore how these models offer insights into deep learning and large language models. Specifically, we will examine a research strategy that trades distributional assumptions about data for precise control over learning behavior in high-dimensional settings. We will discuss several types of phase transitions that emerge in this limit, particularly as a function of data quantity. In particular, we will highlight how discontinuous phase transitions are linked to algorithmic hardness, impacting the behavior of gradient-based learning algorithms. Finally, we will review recent progress in learning from sequences and advances in understanding generalization in modern architectures, including the role of dot-product attention layers in transformers.
About the Vector Distinguished Lecture Series
The Vector Distinguished Lecture Series is a formal gathering of academic and industrial data scientists across the Greater Toronto Area (GTA) to discuss advanced topics in machine learning and its goal is to build a stronger machine learning community in Toronto. The talks will be given by international and local faculty and industry professionals.
The seminar series is intended for university faculty and graduate students in machine learning across computer science, ECE, statistics, mathematics, linguistics, and medicine, as well as PhD-level data scientists doing interesting applied research in the GTA. The Toronto machine learning community will be stronger when we know each other and know what problems people are working on.
Vector Distinguished Lecture Series is currently open to the public remotely. Researchers in the Vector community will have opportunities to meet speakers in person. All talks will be streamed online and be posted on the Vector YouTube Channel.
*This event is open to the public with emphasis on graduate students in machine learning, computer science, ECE, statistics, mathematics, linguistics, medicine, as well as PhD-level data scientists in the GTA.
Note: Event details can change. Please visit the Vector Institute’s website for the latest information about this event.