If you want to train more parameters, you should freeze less parameters from the complete model.
I assume you might be currently freezing all parameters besides the last classifier?
However, since you are dealing with a small dataset, training more parameters might even result in more overfitting.
You could try to apply more aggressive data augmentation or in the best case try to collect more samples.