Welcome



Léon Bottou
NEC Laboratories America
4 Independence Way, Suite 200
Princeton, NJ 08540, USA
Email: myfirstname@bottou.org
Phone: 609-951-2732

I am a research scientist with NEC Labs America's Machine Learning group in Princeton. Although my main main interest is practical and theoretical machine learning, my best known work is probably the DjVu document compression system.

Use the sidebar to navigate this site.

News

Semantic Extraction with a Neural Network Architecture

Use BLAS, not PERL!

It is the nineties again. Ronan Collobert from NEC Labs just released a noncommercial version of his neural network system for semantic extraction. Given an input sentence in plain english, Senna outputs a host of Natural Language Processing (NLP) tags: part-of-speech (POS) tags, chunking (CHK), name entity recognition (NER), and semantic role labeling (SRL). Senna does this with state-of-the-art accuracies, roughly two hundred times faster than competing approaches.

The Senna source code represents about 2000 lines of C. This is probably one thousand times smaller than your usual natural language processing program. In fact all the Senna tagging tasks are performed using the same neural network simulation code.

Download Senna here. A Senna paper has been submitted to JMLR.

2010/02/16 10:16 · Léon Bottou

SGDQN

The SGDQN paper has been published on the JMLR site. This variant of stochastic gradient got very good results during the first PASCAL Large Scale Learning Challenge. The paper gives a lot of explanation on the design of the algorithm. Source code is available from Antoine's web site.

2009/08/07 10:32 · Léon Bottou

ICML 2009

ICML 2009 took place in June. Michael Littman and I were the program co-chairs. Since we were expecting a lot of work, we tried to make it interesting by experimenting with a number of changes in the review process. Read more for a little explanation and a few conclusions…

→ Read more...

2009/07/24 12:31 · Leon Bottou
 
start.txt · Last modified: 2009/07/29 08:14 by leonb
Recent changes RSS feed Creative Commons License DjVu Enabled Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki