Thank you @tom.
Trying to explain my stuff more clearly now:
I am trying to reproduce a simple MNIST example on the CPU (later GPU, but that’s a different topic) with the exact same loss on two machines.
The first machine is my personal laptop, the second machine is in the cloud. They do not share the same hardware. However, BOTH machines are pretty much naked and running everything inside a Docker container, which sets up the whole environment. Therefore, the software environment is absolutely the same.
I fixed all possible seeds and get reproducible results on the respective machines, but NOT BETWEEN the machines.
To summarize: the platforms share everything except for the hardware (CPU, RAM, Mainboard).
(I may ask the same thing again with GPUs, which make the problem more difficult, but this post focuses on the CPU).
If researchers want to reproduce any of my findings, they should be able to at least reproduce the CPU result on their platform, no?