Thank you very much for your response, I really appreciate it.
I meant test accuracy. I also noticed that in Pytorch I never overfit in training! and the training accuracy is around 95~97 but never 100%, unlike Caffe.
In CIFAR100, it gets even worse. The model in Caffe achieves like 77~78% while in Pytorch I can only achieve 75.x% !
Pytorch is a fantastic library and I really love it. However this really turns me down that Caffe gives better accuracy! while this should not be like this!
Concerning the Xavier, what do you mean ? the procedure is straight forward and should not be any different !