Hi joekid,
Its regression problem. I am working on GAN. Data is normalized between -1 to 1 before giving to 1st layer and output of CNN comes in denominator( and i think it should be between -1 to 1 as other data is in the same range) which is used in image restoration.
The question is ReLU will be fine for the data normalized between -1 to 1?? If yes then why it is useful as it clip the negative value which is loss of information.
As we need final output in the range -1 to 1, Is it fine if i use
(1) ReLU except last layer and LeakyReLU in last layer  OR second option is
(2) Receive output between 0 to 1 from last layer and then convert it to range -1 to 1