"Learning features with two-layer neural networks, one step at a time" - Bruno Loureiro, Colloquium

Originally presented on: Monday, Monday 18th ,2024 at 11:30am CT, TTIC, 6045 S. Kenwood Avenue, 5th Floor, Room 530
Title: "Learning features with two-layer neural networks, one step at a time"
Speaker: Bruno Loureiro, École Normale Supérieure
Abstract: Feature learning - or the capacity of neural networks to adapt to the data during training - is often quoted as one of the fundamental reasons behind their unreasonable effectiveness. Yet, making mathematical sense of this seemingly clear intuition is still a largely open question. In this talk, he will discuss a simple setting where we can precisely characterise how features are learned by a two-layer neural network during the very first few steps of training, and how these features are essential for the network to efficiently generalise under limited availability of data.
Based on the following works: arxiv.org/abs/2305.18270, arxiv.org/abs/2402.04980
#machinelearning #computerscience #neuralnetworks #robotics #theory