Hello
I am using SENet-154 to classify with 10k images training and 1500 images validation into 7 classes. optimizer is SGD, lr=0.0001, momentum=.7
after 4-5 epochs the validation accuracy for one epoch is 60, on next epoch validation accuracy is 50, again in next epoch it is 61%. i freezed 80% imagenet pretrained weight.
Training Epoch: 6
Total Params:                      113742455
Trainable Params:                14952711
Non Trainable Params:       98789744
how much percentage of pretrained weight should freezed?.
what could be the problem?
Thanks
Regards
Milton