Causality, NLP, Machine Learning, Deep Dives, Thoughts And Theory.
adapted BERT embeddings for causal inference by predicting propensity scores and potential outcomes alongside a masked language modeling (MLM) objective. In addition to Causal BERT, Veitch et al. also develop a causal amortized topic model to produce causal embeddings, which was adapted from the