Could you check the outputs at the beginning of the training?
Are you seeing random log probabilities, which then converge towards class0?
If so, are you dealing with an imbalanced dataset, which could explain the overfitting to the majority class.