Hi!
I am currently fine tuning a pretrained DenseNet model from torchvision to action recognition task.
In training, model outputs values in the range [-10,10], however, when I pass to the validation phase, the outputs from the last layer of the model explode to a range [-10000, 10000]. This is just the input passed to network and the outputs are from the last fully connected layer.
I use the same loop for training and validation.
What may be the cause of this ?
Thanks!