I would guess this PR 4 changing the nn.ReLU backward pass might have disallowed the following dropout layer to manipulate the outputs inplace, as they are now used during the backward().
It’s strange to hear you are seeing a 2X slowdown. Could you give more information about the used device and setups, as I think the slowdown might be unrelated to the PR.