====== Locally Regularized Learning Systems ======


After joining [[wp>Bell_Labs|AT&T Bell Laboratories]] in 1991, I worked with [[wp>Vladimir Vapnik]] on the links between learning technique and the widely used regularization techniques. I applied local regularization methods to optical character recognition and bettered all previous systems on our USPS benchmark with a 3.3% error rate. Alas the algorithm was quite slow.
Three months later, [[http://research.microsoft.com/~patrice|Patrice Simard]] 
took the record, achieving 2.5% error with //Tangent Distances//.
I do not remember which was the slowest algorithm. 

{{ local.png?224 }}

===== Publications =====


<box 99% orange>
Léon Bottou and Vladimir N. Vapnik:  **Local Learning Algorithms**,  //Neural Computation//, 4(6):888-900, 1992.

[[:papers/bottou-vapnik-92|more...]]
</box>

<box 99% orange>
Vladimir N. Vapnik and Léon Bottou:  **Local Algorithms for Pattern Recognition and Dependencies Estimation**,  //Neural Computation//, 5(6):893-909, 1993.

[[:papers/vapnik-bottou-93|more...]]
</box>

<box 99% orange>
Léon Bottou, Corinna Cortes, John S. Denker, Harris Drucker, Isabelle Guyon, Lawrence D. Jackel, Yann Le Cun, Urs A. Muller, Eduard Säckinger, Patrice Simard and Vladimir Vapnik:  **Comparison of classifier methods: a case study in handwritten digit recognition**,  //Proceedings of the 12th IAPR International Conference on Pattern Recognition, Conference B: Computer Vision & Image Processing.//, 2:77-82, IEEE, Jerusalem, October 1994.

[[:papers/bottou-cortes-94|more...]]
</box>