What is the true distribution in this case? You can try something similar to VAE (Variation Auto Encoder), let the network predict the parameters of the distribution in case of Gaussian it is N means and N std’s. Then sample from the output and try to match that with the label and use KL between a predefined Gaussian such as N(0, 1) and your model output.