I tried

Freezing Resnet18 upto layer3 module  (got train_acc 90% and validation acc 68%)
Freezing resNet18 upto layer4 module and changed fc layer (got train_acc 99% and validation acc 79%)

Same problem I faced with Inceptionv3, resnet34 and resnet50