In that case, try to overfit a small data samle and play around with some hyperparameters.
Also, have you checked the targets and tried to visualize some of them?
Your current mapping looks a bit weird, as you are using 16 decimal places. How did you calculate these values and are you sure your target image only contains these three values?