Try to overfit a small dataset, e.g. just 10 samples, by playing around with the hyperparameters, architecture etc.
Once your model is able to do so, try to scale up the use case again by using more data.