What do you mean “it is getting worse” ?
The loss doesn’t decrease ? The accuracy doesn’t increase ?
You only show the output of the model, which does not reflect its performance.
If you cannot make it learn, try to train your model on a very small amount of data, to see if it can at least overfit.