Solved by justusschock in post #2 
              
              
                They are basically the same. The functional version can’t be used in structures like torch.nn.Sequential etc. Beside that it should be your own choice whether to use the layer (initialize it and call it) or call the functional API.