I’ve been using batch sizes of 24 or 32.
That makes sense actually, while I was cleaning my data some of the images looked corrupt. I’ll look through the dataset.
There was 1 out of 98000 images that were faulty. Doesn’t seem like it’s the issue. The corrupted images would either be in the test or train set. Each epoch will iterate over every image since I track test loss and accuracy. Epoch 1 survives so I don’t think there’s an issue with images.
Currently training after removing the image. Will update.
I:\Ana\lib\site-packages\torch\utils\data\dataloader.py in _try_get_data(self, timeout)
    760         try:
--> 761             data = self._data_queue.get(timeout=timeout)
    762             return (True, data)

I:\Ana\lib\multiprocessing\queues.py in get(self, block, timeout)
    104                     if not self._poll(timeout):
--> 105                         raise Empty
    106                 elif not self._poll():

Empty: 

During handling of the above exception, another exception occurred:

RuntimeError                              Traceback (most recent call last)
<ipython-input-12-85b51d9eba09> in <module>
     20     #fetch_time = time.time()
     21 
---> 22     for b, (X_train, y_train) in enumerate(train_loader):
     23         if b == max_trn_batch:
     24             break

I:\Ana\lib\site-packages\torch\utils\data\dataloader.py in __next__(self)
    343 
    344     def __next__(self):
--> 345         data = self._next_data()
    346         self._num_yielded += 1
    347         if self._dataset_kind == _DatasetKind.Iterable and \

I:\Ana\lib\site-packages\torch\utils\data\dataloader.py in _next_data(self)
    839 
    840             assert not self._shutdown and self._tasks_outstanding > 0
--> 841             idx, data = self._get_data()
    842             self._tasks_outstanding -= 1
    843 

I:\Ana\lib\site-packages\torch\utils\data\dataloader.py in _get_data(self)
    806         else:
    807             while True:
--> 808                 success, data = self._try_get_data()
    809                 if success:
    810                     return data

I:\Ana\lib\site-packages\torch\utils\data\dataloader.py in _try_get_data(self, timeout)
    772             if len(failed_workers) > 0:
    773                 pids_str = ', '.join(str(w.pid) for w in failed_workers)
--> 774                 raise RuntimeError('DataLoader worker (pid(s) {}) exited unexpectedly'.format(pids_str))
    775             if isinstance(e, queue.Empty):
    776                 return (False, None)

RuntimeError: DataLoader worker (pid(s) 2636) exited unexpectedly

This error popped up at Epoch 3 about halfway through.