Hi Ptrblck,
I am currently using pytorch 1.4.0

import torch
print(torch.version)
1.4.0

Unfortunataly the BCE dump is over 3GB and as a result is abit unweildy…
I am re-running asking for the min max and mean from the output for each epoch up to 38 and then at each increment from epoch 38 onwards (along with output from the decoder).
I will take a screen grab for the last few iteration before fail and copy them in to the post.
do you have any thoughts on what maybe causing this?
One thing though, it seems to be generating a -ve minimum BCE value:

7 6912 tensor(13018.4346, device=‘cuda:0’, grad_fn=) tensor(0.5092, device=‘cuda:0’, grad_fn=) tensor(-0., device=‘cuda:0’, grad_fn=) tensor(1.5307, device=‘cuda:0’, grad_fn=) tensor(0.3879, device=‘cuda:0’, grad_fn=) tensor(0.1181, device=‘cuda:0’, grad_fn=) tensor(1., device=‘cuda:0’, grad_fn=)

chaslie