Thanks for your answer. Unfortunately, limiting to [-1,1] is required. Values outside of this range would mean that my network detects points outside of the image which makes no sense.
What do you mean by “The learning rates don’t mean anything to me”? That I should reduce the learning rate?