I would try to scale down the problem size and try to overfit a smaller data sample.
E.g. use only 10 batches of the desired batch size and try to make your model converge.
Also, another maybe “unusual” value is the high number of input features to the first linear layer.
I would try to lower this number by either resizing the images or adding another conv/pool layer.