Thank you very much.
I think what confuses me is the concept of layer. When I implement the first layer of neurons I set a number for it’s inputs and it’s outputs. So is the input layer only the first part of it and the outputs belong already to the hidden layer and not the input layer anymore? That’s the point that made me think I might applied the activation function to the input layer.
Edit: So my code example above has in fact two hidden layers not one am I right? The self.fc() just implements the connection between two layers?