I don’t know if there are good approaches of setting milestones besides running a lot of experiments.
As the default I would try to reduce the learning rate once the validation loss doesn’t decrease significantly anymore via lr_scheduler.ReduceLROnPlateau 4.