Yes there is class imbalance 68:32. I tried under-sampling but it didn’t make much of a difference.
The mean accuracy increases to 84% by the 6th epoch, then bounces back and forth between 79% and 89%.
This happens with very big batch sizes. With small batch size it can even bounce between 75% and 97%.