I just defiend the nn.ReLU module as self.act and am reusing it on the layer’s output.
You could alternatively remove self.act and use F.relu instead.
Yes, self.out is a linear (fully-connected) layer.