What could cause a validation step to look so much different from a training step ?

bouncy.png390×657 30.1 KB

The network running is almost the same as this Places365 one, but with only two classes.
The Validation Dataset is equally divided in the two classes.
It almost looks like the network is ignoring one of the classes during training.
Thanks.