Be warned, Google shows " relu() is a layer that has weights and bias whereas F. relu is just a activation function." instead of @Huy_Ngo s  answer to my research “nn.ReLU or F.relu ?” so if someone does not click on the page he/her will see a bad answer