Could you potentially try a learning rate in between lr/100 and lr/512, or potentially stick with lr/100 and decay the learning rate over time? Also, this might be a better question for the fastai forums, since it uses fastai’s library: https://forums.fast.ai/c/fastai-users 4