Causal Inference, Machine Learning, Domain Adaptation, Reinforcement Learning.
Counterfactual reasoning in Thompson sampling could help prevent unobserved confounders from causing the agent to pick a suboptimal approach. For example, a gambler is sitting in front of two slot machines and has Beta distributions for each of the slot machines. Let’s consider two additional