The inplace operation (assuming it’s allowed and doesn’t raise an error) would save the memory for the intermediate output activation, but would prevent potentially fusing this dropout layer with other layers if I’m not mistaken.