Solved by ptrblck in post #7 
              
              
                I cannot reproduce the slowdown using your (partial) code snippets and get approx. 0.0152s/iter for CPU and 0.00044s/iter for a GPU run using: 
import torch
import torch.nn as nn
import torch.nn.functional as F
import time

class GraphConvolution(nn.Module):
    def __init__(self, in_features, out_f…