Yeah, so PyTorch will track your computation and then backpropagate through it. The idea of the functional interface is that you can do wild computation around the standard functions.
For example, @ptrblck and I did this when we implemented the style GAN’s weight-scaling for convolutions (and linear layers, which have the commentary around it).
Best regards
Thomas