Hi,
I have been experiencing this problem for a while, and it only happens with somewhat large datasets > 1M.
The training speed at the first epoch is about 5~6 times slower than the next epochs, and it is not just the first few iterations (cold start). The speed gradually gets faster, but on average, it is about 5~6 times slower.
Do any of you have an idea of what could be happening?
I am using a data loader based on image list files:

  
      github.com/pytorch/vision
  
  
    



Issue: load image dataset from list files 21


	
	opened by xiahouzuoxin
	on 2017-03-01
	
	
	closed by fmassa
	on 2017-11-12
	


I suggest to add a IO for read images from a list like this to support custom image data input,
img1 label1
img2...


 	awaiting response


  
  
    
    
  
  


Thanks a lot in advance.