bat67:

As they are all model input without requiring grad


That makes no difference, inputs are used in the first layer in some operation that works like: layer1(input, weights1). That operation is normally multiplication-based, so weights1 gradient computation depends on input, and inplace += op rewrites it