It doesn’t stop calculating parts of the model, it just substitutes zeros in many places and does the calculations with the zeros and all the other values.
Calculations with sparse matrices are not easy to do efficiently and pytorch doesn’t use them for dropout.