Try to scale down the use case and overfit a small dataset, e.g. just 10 samples by playing around with the hyperparameters.
If that doesn’t work at all there might be an issue in the code we haven’t seen yet.