no special layers only a deep CNN network
and i worked well at first 3 epochs and this happens after 47% of the epoch 4
i reduced learning rate from 0.001 to 0.0001, and eps from 1e-8 to ie-7 and restart training at epoch 4
it’s working fine until now
if it start to do it again i will follow up with you
thanks for following up