I’m glad it’s working.
Stanford’s CS231n states that the ratio of weights:updates should be roughly 1e-3 (source 4).
I’m not sure, it that’s still a valid assumption today, especially with some tricks and hacks to accelerate the training.