I’ll have to get back to you on Monday, but I’ve been getting something like Model3d object is not callable. I’m pretty sure I built the latest stable version of from sources, I’ll update my reply on Monday.
Thanks
UPDATE:
I take back what I said about the model not being callable, I’m calling the model on the inputs now and its fine. I have also found out that the nan value in my gradients is always in model.up_classifier_weight, which means that the loss function I’m using is probably the culprit. The loss values themselves seem normal though.
I solved the GPU utilization issue by calling nn.DataParallel on my model.