Hey!
Thanks for the suggestions. I have kept the model for training with dropout(0.8) and also weight decay 0.01 and also included a scheduler for lr adjustment.
Is it possible to asses how changing the output layer from one mentioned above to given below effect:
Linear(in_features=2048, out_features=1024, bias=True)
…
…
Linear(in_features=1024, out_features=3, bias=True)
All i can infer is that there are less parameters and might takes less time to train.