You means that it is better to reduce the number of layers ? to have more considerable gradient?
The activation function in the last layer is Sigmoid and middles are ReLU, with batch norm. Do you think
BatchNorm2d can have effect on gradients?