PyTorch activations use the functional API under the hood 7. So you can safely use one or the other. However, the nn.module additionally implements _repr_ which lets you easily pretty print a summary of your network.