activations refers to the layer outputs in this context, not a specific activation function such as nn.ReLU so it’s not possible to “switch it off” without manipulating the return statement in the layer’s forward method.