I would recommend to try to overfit a small dataset, e.g. just 10 samples, and check if the model would be able to do so. If not, I would guess there might be another issue in the code, which we haven’t found yet.