http://leon.bottou.org/ 2013-05-24T03:02:27-04:00 http://leon.bottou.org/ http://leon.bottou.org/lib/tpl/arctic/images/favicon.ico text/html 2013-05-21T18:10:28-04:00 leonb http://leon.bottou.org/papers/tr-bottou-2012?rev=1369174228 Counterfactual Reasoning and Learning Systems Abstract: This work shows how to leverage causal inference to understand the behavior of complex learning systems interacting with their environment and predict the consequences of changes to the system. Such predictions allow both humans and algorithms to select changes that improve both the short-term and long-term performance of such systems. This work is illustrated by experiments carried out on the ad placement system associated with the Bing s… text/html 2013-05-19T15:08:21-04:00 leonb http://leon.bottou.org/talks/counterfactuals?rev=1368990501 Variants of this talk were given in several occasions. The slides below were presented at the Machine Learning Summit 2013. See also lectures 9 and 11 in the NYU course on Big Data and Machine Learning. Summary Statistical machine learning technologies in the real world are never without a purpose. Using their predictions, humans or machines make decisions whose circuitous consequences often violate the modeling assumptions that justified the system design in the first place. Such contradictio… text/html 2013-05-19T14:49:03-04:00 leonb http://leon.bottou.org/talks?rev=1368989343 This page contains pointers to my most significant lectures. All the slides are available under both the PDF and DjVu formats. * The BackPropagation CookBook * Graph Transformer Networks * DjVu: Scanned Documents on the Web * Online Learning and Stochastic Approximations * The Tradeoffs of Large Scale Learning * Stochastic Algorithms for One Pass Learning * Counterfactual Reasoning and Learning Systems text/html 2013-05-19T14:15:22-04:00 leonb http://leon.bottou.org/wiki/playground?rev=1368987322 Foo text/html 2013-05-19T07:07:36-04:00 leonb http://leon.bottou.org/papers/bottou-fs-2013?rev=1368961656 In hindsight: Doklady Akademii Nauk SSSR, 181(4), 1968 Abstract: This short contribution presents the first paper in which Vapnik and Chervonenkis describe the foundations of the Statistical Learning Theory. The original paper was published in the Doklady, the Proceedings of the USSR Academy of Sciences, in 1968. An English translation was published the same year in Soviet Mathematics, a journal from the American Mathematical Society publishing translations of the mathematical section of the Do… text/html 2013-05-19T06:57:23-04:00 leonb http://leon.bottou.org/?image=papers%3Avapnik-symposium-2011.pdf&ns=papers&rev=1368961043&do=media text/html 2013-05-19T06:51:14-04:00 leonb http://leon.bottou.org/papers/bottou-mlj-2013?rev=1368960674 From machine learning to machine reasoning: an essay This essay is an version of a 2011 tech report. Abstract: A plausible definition of “reasoning” could be “algebraically manipulating previously acquired knowledge in order to answer a new question”. This definition covers first-order logical inference or probabilistic inference. It also includes much simpler manipulations commonly used to build large learning systems. For instance, we can build an optical character recognition system by firs… text/html 2013-05-19T06:30:56-04:00 leonb http://leon.bottou.org/papers?rev=1368959456 Follow each publication link to access papers and supplemental data. Most papers are available in DjVu, PDF, and PS.GZ. Download a DjVu viewer. 2013 Léon Bottou: In hindsight: Doklady Akademii Nauk SSSR, 181(4), 1968, Festschift for Vladimir Vapnik's 75th birthday, Springer, Springer. more... text/html 2012-12-24T12:24:54-04:00 leonb http://leon.bottou.org/?image=papers%3Atahoe.jpg&ns=papers&rev=1356369894&do=media <img src="/_media/papers/tahoe.jpg?w=500&h=119t=1356369894&amp;tok=964fff" alt="papers:tahoe.jpg" /> text/html 2012-12-24T11:54:38-04:00 leonb http://leon.bottou.org/?image=research%3Awall2.png&ns=research&rev=1356368078&do=media <img src="/_media/research/wall2.png?w=287&h=206t=1356368078&amp;tok=febed7" alt="research:wall2.png" /> text/html 2012-12-24T11:24:50-04:00 leonb http://leon.bottou.org/?image=research%3Ainvar.png&ns=research&rev=1356366290&do=media <img src="/_media/research/invar.png?w=500&h=302t=1356366290&amp;tok=3207d2" alt="research:invar.png" /> text/html 2012-12-24T11:24:50-04:00 leonb http://leon.bottou.org/?image=research%3Ainvar.jpg&ns=research&rev=1356366290&do=media <img src="/_media/research/invar.jpg?w=500&h=474t=1356366290&amp;tok=e31469" alt="research:invar.jpg" /> text/html 2012-12-24T11:16:50-04:00 leonb http://leon.bottou.org/?image=research%3Acvpr04.jpg&ns=research&rev=1356365810&do=media <img src="/_media/research/cvpr04.jpg?w=436&h=500t=1356365810&amp;tok=854040" alt="research:cvpr04.jpg" /> text/html 2012-12-24T11:16:50-04:00 leonb http://leon.bottou.org/?image=research%3Asdnn2.png&ns=research&rev=1356365810&do=media <img src="/_media/research/sdnn2.png?w=499&h=455t=1356365810&amp;tok=32fe59" alt="research:sdnn2.png" /> text/html 2012-09-14T16:26:40-04:00 leonb http://leon.bottou.org/?image=projects%3Asgd-2.1.tar.gz&ns=projects&rev=1347654400&do=media text/html 2012-08-01T17:29:09-04:00 leonb http://leon.bottou.org/?image=bottou_75.jpg&ns=&rev=1343856549&do=media <img src="/_media/bottou_75.jpg?w=75&h=75t=1343856549&amp;tok=010cf2" alt="bottou_75.jpg" /> text/html 2011-10-12T20:40:54-04:00 leonb http://leon.bottou.org/?image=papers%3Asumma-2011.jpg&ns=papers&rev=1318466454&do=media <img src="/_media/papers/summa-2011.jpg?w=327&h=500t=1318466454&amp;tok=ca0c8e" alt="papers:summa-2011.jpg" /> text/html 2011-10-12T12:47:13-04:00 leonb http://leon.bottou.org/?image=projects%3Asgd-2.0.tar.gz&ns=projects&rev=1318438033&do=media text/html 2011-10-11T14:46:56-04:00 leonb http://leon.bottou.org/?image=projects%3Acrf-f1.png&ns=projects&rev=1318358816&do=media <img src="/_media/projects/crf-f1.png?w=500&h=339t=1318358816&amp;tok=ba914e" alt="projects:crf-f1.png" /> text/html 2011-10-11T14:08:14-04:00 leonb http://leon.bottou.org/?image=projects%3Aalpha-cost.png&ns=projects&rev=1318356494&do=media <img src="/_media/projects/alpha-cost.png?w=499&h=328t=1318356494&amp;tok=ddfdac" alt="projects:alpha-cost.png" />