I don’t see anything wrong with your implementation. You might want to perform some hyperparameter optimization to see if you get any better results. Also, I am sure you may have across this 3 work. See if there’s anything in there that can help engineer your model towards a better performance. Sorry for not being much helpful. Good Luck!