You could use a small subset of the dataset (e.g. just 10 samples) and try to overfit your model on it by playing around with the hyperparameters etc. Once this is done you could scale up the use case again.