Yes, the LAE and the ELoss are pretty similar in the first epoch on both machines. I noticed that activations and gradients blow up in the very first batch for no apparent reason, I will post a screen shot tomorrow, since the more powerful machine is my work machine.
I will try to code up a little snippet tomorrow for the encoder part of the model so you could try to reproduce the behavior. Thank you for your help.