Data Science, Statistics, Analytics, Experiment, Causality.
you don’t have to discard any of your user base and the “untouchable” customers enhance statistical power by providing a tighter estimate of the intercept, if linearity is assumed. Bayesian analysis would treat the covariates as crossed random effects. (Not sure how to analyze the interaction