@cesarsouza this happens with multiple gpus and we have a customized bn layer that we suspect is triggering the segfault in some way. The code used to work on previous versions of pytorch and training was working with our layer.