@AlphaBetaGamma96 Here is a output sample:
sdactivations: 0.9688094258308411, sdloss: 0.8842137455940247
lossItem: 3.0881900787353516
Epoch: [0][0/160]	Time 0.307 (0.307)	Data 0.256 (0.256)	Speed 834.981 (834.981)	Loss 3.0882 (3.0882)	Acc@1 8.594 (8.594)	Acc@5 46.875 (46.875)	Count 256
sdactivations: 1.056261420249939, sdloss: 0.9665254354476929
lossItem: 2.8299927711486816
sdactivations: 1.2517436742782593, sdloss: 1.4695396423339844
lossItem: 2.0257301330566406
sdactivations: 1.635145664215088, sdloss: 2.187786817550659
lossItem: 1.4797642230987549
sdactivations: 2.0124547481536865, sdloss: 4.278054237365723
lossItem: 0.874698281288147
sdactivations: 2.4762659072875977, sdloss: 5.951650142669678
lossItem: 0.6256335377693176
sdactivations: 2.857673406600952, sdloss: 4.7043633460998535
lossItem: 0.8196429014205933
sdactivations: 3.238481283187866, sdloss: 5.849048614501953
lossItem: 0.640394926071167
sdactivations: 3.587682008743286, sdloss: 6.391217231750488
lossItem: 0.6264476776123047
sdactivations: 3.893690347671509, sdloss: 4.930907249450684
lossItem: 0.7258576154708862
sdactivations: 4.203991413116455, sdloss: 6.16979455947876
lossItem: 0.5993886590003967
sdactivations: 4.498993396759033, sdloss: 9.638185501098633
lossItem: 0.5030274987220764
sdactivations: 3.3001585006713867, sdloss: 3.1007816791534424
lossItem: 2.634819507598877
sdactivations: nan, sdloss: nan
lossItem: nan

As they are getting nan all at the same time I think this should not be an issue