Thanks, I chose to remove it but now I am getting nans which is probably because I did not readjust my metrics. Could you explain what you meant ? Also I was advised to add another relu after the third convolution.