Hi ,
I was building my own transpose cnn for scratch and I noticed a tiny difference between mine and pytorch at roughly 10^-7 digits onwards, so I was just suprised.
I have been writing my stuff on CPU so I did not take into GPU issues.
Its mostly a learning experience for me. Nothing to report but I would be interested to check if float 64 might reduce iterations a bit in the training process (in gpu this would be at the cost of computational speed and probably not worth doing).