Causality, NLP, Machine Learning, Deep Dives, Thoughts And Theory.
adapting pre-trained language models (eg. BERT) or supervised topic models (eg. sLDA) to predict the treatment and outcome. For example, Vietch et al. (2020) adapted text embeddings for causal inference by learning low-dimensional variables that predict the treatment and outcome; they proved that