Hi all. Last time I complained that my MSE loss is not converging with Adam optimizer and ResNet50 architecture. I think I may have found the problem but I’m not sure.
For now I’m simply feeding the prediction of my ResNet50 and the target value to the MSE loss, i.e. loss = criterion(output, target.float()). In my research, instead of using the ResNet50 to do the prediction directly, I want to predict a “residual”, which means loss = criterion(output, target.float() - something). However, if I do this, then the loss does not converge. It fluctuates around the starting point instead. Can someone give some possible explanation?