Hello
I am not getting good results training my simple fully connected layered network. I am aware that since it is a highly non-convex function, i am probably just finding the local minimum.  I have constructed my own resnet, with Kaiming initialization, and relu as activation function.  In search of improving my result, I am now considering pre-training the network with rbm, since i think it will regularize my optimization problem.
My question is if anyone has any experience doing pretraining on pytorch? Does pytorch have build in method to do it ( I didn’t see any) ?  Is this even a good idea ?
Thank you