===== Stochastic Learning ===== This paper summarizes my lecture at the [[http://www.irccyn.ec-nantes.fr/mlschool/mlss03/home03.php|Machine Learning Summer School 2003, Tübingen]]. //Abstract//: This contribution presents an overview of the theoretical and practical aspects of the broad family of learning algorithms based on Stochastic Gradient Descent, including Perceptrons, Adalines, K-Means, LVQ, Multi-Layer Networks, and Graph Transformer Networks. Léon Bottou: **Stochastic Learning**, //Advanced Lectures on Machine Learning//, 146-168, Edited by Olivier Bousquet and Ulrike von Luxburg, Lecture Notes in Artificial Intelligence, LNAI 3176, Springer Verlag, Berlin, 2004. [[http://leon.bottou.org/publications/djvu/mlss-2003.djvu|mlss-2003.djvu]] [[http://leon.bottou.org/publications/pdf/mlss-2003.pdf|mlss-2003.pdf]] [[http://leon.bottou.org/publications/psgz/mlss-2003.ps.gz|mlss-2003.ps.gz]] @incollection{bottou-mlss-2004, author = {Bottou, L\'{e}on}, title = {Stochastic Learning}, booktitle = {Advanced Lectures on Machine Learning}, pages = {146-168}, publisher = {Springer Verlag}, year = {2004}, editor = {Bousquet, Olivier and von Luxburg, Ulrike}, series = {Lecture Notes in Artificial Intelligence, LNAI~3176}, address = {Berlin}, url = {http://leon.bottou.org/papers/bottou-mlss-2004}, }