Solved by ptrblck in post #4 
              
              
                I don’t know the theoretical complexities of both algorithms and how they are implemented. 
If you are concerned about the performance of these layers, you could profile them via e.g. the torch.utils.benchmark utilities.