Could you also tell me how to pass those parameters
to the forward function without having to calculate the backprop for them?
When I pass 5 parameters to the forward function including 2 that are non-trainable hyperparameters, Pytorch asks me to return 5 gradients.