title: CZ-GEM:  A  FRAMEWORK  FOR DISENTANGLED REPRESENTATION LEARNING
abstract: Learning disentangled representations of  data is one of the central themes in unsupervised learning in general and generative modelling in particular.  In this work,  we tackle a slightly more intricate scenario where the observations are generated from a conditional distribution of some known control variate and some latent noise variate.  To this end, we present a hierarchical model and a training method (CZ-GEM) that leverages some of the recent developments in likelihood-based and likelihood-free generative models.  We show that by formulation, CZ-GEM introduces the right inductive biases that ensure the disentanglement of the control from the noise variables, while also keeping the components of the control variate disentangled. This is achieved without compromising on the quality of the generated samples. Our approach is simple, general, and can be applied both in supervised and unsupervised settings.
authors: Akash Srivastava Yamini Bansal Yukun Ding Bernhard Egger Prasanna Sattigeri Josh Tenenbaum David D. Cox Dan Gutfreund
hIndex: Josh Tenenbaum 108