The scale of the gradient depends on many things, in particular, the value of the Tensor itself.
Also, the learning rate you use might change completely the scale of the gradients you expect to see.
I am afraid I don’t have an answer for the beyond: whatever works for your model