Hi @vvanirudh, I’m not sure whether you’re familiar with the phenomena, but when you train nets or statistical model which use multivariate normalized distributions, usually something called “factor rotation” occurs.
Basically, all the correlations will go to zero, so usually you don’t have to worry about modelling the full co-variance matrix - it simplifies things considerably - maybe this would be a good starting point?