Hi Tassilo!



 TJKlein:

I use MINE as a loss (x,z, are inputs and T is an embedding network)


It is not clear what you are doing here.  (For example, the forward()
method of your MINE class uses self.T, but self.T is never defined.)
Could you simplify your code down to the bare essentials that reproduce
your issue and then post the simplified version as a complete, runnable
script?
Best.
K. Frank