Are you sure this method works? because I dont see any Forbineous norm calculation done here!
Also I noticed using your method, the loss goes haywire! the reconstruction works regardless of the second loss, so I’d be very grateful if you could explain this and share with us the code you used for multi-layerd CAE.