Hi,
It depends what you mean by “much slower”. It runs in python while the nn.ReLU version is implemented completely in c++ so it will be a bit faster.
Do you have benchmark that show surprising results?