Solved by ptrblck in post #2 
              
              
                Note that the theoretical computational cost might differ from the used implementation, so a proper way would be to profile both workloads via e.g. torch.utils.benchmark.