The learning rate scheduler warning might be raised, if the gradients contained invalid values and the optimizer.step() was thus skipped.
Which opt_level in apex are you using and did you use the same CUDA and cudnn versions for the comparison?