Hi,
In your implementation, do you use ConvTranspose2d or Upsampling?
Regarding your points:

I intentionally changed the range to 0-255 since the range 0-1 resulted the same problem.
The problem persists with or without batch normalization. However, I’m using batch size of 16 in my recent attempts.
I think it’s not fair to relate the problem to pre-trained initialization as there is the same theano implementation which is trained from scratch and works like a charm!!

Thanks for you reply.