As title says, does PyTorch perform some kind of under-the-hood optimizations for zeroed-out parameters in a network’s layers? I.e., would the forward() method of a normal network be slower than the same architecture but with some of its weights set to 0?