Ok, thank you. To come back to my initial question with the activation function,
if fc1 is indeed my input layer why is the application of relu still fine? I’ve read that input layers don’t have an activation function only hidden and output layers do. I hope it’s clear now what my point of confusion is.
Edit: So basically this is it of what I don’t get why it still should be fine:

x= self.fc1(input)
x = nn.functional.relu(x)