Hi. This will only use one core on my machine :
I’m using Gulpio to load the data. I don’t think the error comes from there though, after analyze of the differences between gulpio DataLoader and pytorch’s.

  
      
      GitHub
  
  
    

TwentyBN/GulpIO 6

GulpIO - Binary storage format for deep learning on videos.


  
  
    
    
  
  


from multiprocessing import set_start_method
if __name__ === '__main__':
    #nothing makes it work properly
    #set_start_method('spawn')
    #set_start_method('fork')
    #set_start_method('forkserver')


#no matter what value I put in there
threads=12

dataset_train = GulpVideoDataset('/hdd/cropped_videos/gulped_train', \
            num_frames=num_frames, target_fps=target_fps, is_val=False)
data_loader_train = DataLoader(dataset_train, batch_size=bs, \
            sampler=WeightedRandomSampler(weights=weights,num_samples=dataset_length_train, \
            replacement=True), drop_last=True, num_workers=threads)

for data, labels in data_loader_train:
    print('hey')


pip3 list gives
gulpio (521.36)
torch (0.3.0.post4)
torchvision (0.2.0)
Do you know what I’m doing wrong please ?