Hi,
I am training a cnn that outputs an image.
My loss goes down well, and then it jumps and keep ± constant.
Did someone saw this phenomenom?
It happens on the first or second epoch.
I tried to use Adam , SGD, and also changed the activaitions with no luck.
The only thing that helps is to learn less conv filters.
Someone has an idea?
Thanks,
Nitsan