Could you try to open the images with PIL, convert to numpy as to copy them and close the PIL files so you are sure that you are not manipulating the images somwhere by mistake. As it is being read properly the first time but not the second i.e next epoch.