Yes, it’s just a wrapper so that I can access the attributes (so I don’t need to add .module). If so, below is the output for my actual code:

Forward latency is: 437033.9375
end - start =  437.031393879035

So what do you think is wrong with the parallel implementation that takes double as much time to run with two GPUs?