Depends what are the size of the images or the length of your epoch. But in semantic segmentation is not rare for an epoch to take few hours.
Also, this question is best suited for that repository, I believe has little to do with pytorch.