Hi, thanks for the advice. I increased the cov2d layer sizes and set the first layers kernel size to 3 and set the optimiser to Adam which seems to have increased performance.
I agree that for this task transfer learning would yield better results but I wanted to try and implement and train my own network.