This is an old revision of the document!
Abstract: Using the search engine ad placement problem as an example, we explain the central role of causal inference for the design of learning systems interacting with their environments. Thanks to importance sampling techniques, data collected during randomized experiments gives precious cues to assist the designer of such learning systems and useful signals to drive learning algorithms. Thanks to a sharp distinction between the learning algorithms and the extraction of the signals that drive them, these methods can be tailored to causal models with different structures. Thanks to mathematical foundations shared with physics, these signals can describe the response of the system when equilibrium conditions are reached.
arXiv link
tr-2012-09-12.djvu
tr-2012-09-12.pdf
tr-2012-09-12.ps.gz
@techreport{tr-bottou-2012, author = {Bottou, L\'eon and Peters, Jonas and Qui\~{n}onero-Candela, Joaquin and Charles, Denis X. and Chickering, D. Max and Portugualy, Elon and Ray, Dipankar and Simard, Patrice and Snelson, Ed}, title = {Counterfactual Reasoning and Learning Systems}, institution = {arXiv:1209.2355}, month = {September} year = {2012}, url = {http://leon.bottou.org/papers/tr-bottou-2012}, }