I think it’s a good idea to skip the distributed run for now to reduce the scope of the issue to the reproducibility. Based on the nightly error, it seems as if a deterministic version of a pooling layer is causing an error. Could you post the model definition or the pooling layers with their input shapes so that we could debug it further?