I’m doing more experiments, the issue was when using 4 GPUs, with 1 GPU the result is expected
ResNet18 on 1GPU finetune:
Training complete in 21m 37s
Best val Acc: 0.953708
ResNet18 on 1GPU freeze:
Training complete in 8m 30s
Best val Acc: 0.692327
ResNet18 on 4GPU finetune:
Training complete in 10m 11s
Best val Acc: 0.954220
ResNet18 on 4GPU freeze:
Training complete in 9m 42s
Best val Acc: 0.686957
I’m curious to know if the issue is because the dataset is too small for 4 GPUs (20k images) or due to the small network ResNet18