You could try to overfit a small dataset, e.g. just 10 samples, by playing around with the hyperparameters and check, if this simple model is able to learn the data. Once this is done you could scale up the use case again by using more data.