====== Locally Regularized Learning Systems ======
After joining [[wp>Bell_Labs|AT&T Bell Laboratories]] in 1991, I worked with [[wp>Vladimir Vapnik]] on the links between learning technique and the widely used regularization techniques. I applied local regularization methods to optical character recognition and bettered all previous systems on our USPS benchmark with a 3.3% error rate. Alas the algorithm was quite slow.
Three months later, [[http://research.microsoft.com/~patrice|Patrice Simard]]
took the record, achieving 2.5% error with //Tangent Distances//.
I do not remember which was the slowest algorithm.
{{ local.png?224 }}
===== Publications =====
Léon Bottou and Vladimir N. Vapnik: **Local Learning Algorithms**, //Neural Computation//, 4(6):888-900, 1992.
[[:papers/bottou-vapnik-92|more...]]
Vladimir N. Vapnik and Léon Bottou: **Local Algorithms for Pattern Recognition and Dependencies Estimation**, //Neural Computation//, 5(6):893-909, 1993.
[[:papers/vapnik-bottou-93|more...]]
Léon Bottou, Corinna Cortes, John S. Denker, Harris Drucker, Isabelle Guyon, Lawrence D. Jackel, Yann Le Cun, Urs A. Muller, Eduard Säckinger, Patrice Simard and Vladimir Vapnik: **Comparison of classifier methods: a case study in handwritten digit recognition**, //Proceedings of the 12th IAPR International Conference on Pattern Recognition, Conference B: Computer Vision & Image Processing.//, 2:77-82, IEEE, Jerusalem, October 1994.
[[:papers/bottou-cortes-94|more...]]