The runtime depends on your current setup (hardware as well as libraries) as well as your model.
That being said, is a single epoch using 500 images taking “a couple of hours”?
If so, could you post the model architecture as well as the training loop, as this seems to be too slow.