No, nn.Module subclasses only add support for some convenience methods like .parameters(), .cuda() and some others. It’s possible to implement neural networks in autograd without modules, and some people actually prefer this style. But this means that you’ll need some additional helpers and custom data structures for handling parameters.