Dear @JuanFMontesinos
I am optimizing the followings:

The VAE
The regression

And the input to the regression is the latent space of the VAE.
I would like to use the regression loss to change the weight of the regression portion of the model, and the VAE loss to change the VAE  weights