What I would like to know is how to choose a reasonable number for the step size. This is a multilabel classification with 21 labels.
My batch size is 8. And the number of images is 7000 images. Number for gradient accumulation
is 4.
Thank you