@Martyn I would suggest picking up a much simpler dataset like


geometric shape data : Four Shapes | Kaggle


MNIST Fashion


Once your code works for these, you can easily extend it to complicated datasets. But you will have ironed out many issues by this time