Hi,
My program started to hang up randomly. I prepend the variable CUDA_LAUNCH_BLOCK=1, but it doesn’t show me any error line related to my code. Running with workers=0 takes ~7.25s per iteration (~2 hours per epoch) 
Any tips for debugging that. Patience?
what():  CUDA error: initialization error
Exception raised from insert_events at /opt/conda/conda-bld/pytorch_1595629411241/work/c10/cuda/CUDACachingAllocator.cpp:717 (most recent call first):frame #0: c10::Error::Error(c10::SourceLocation, std::string) + 0x4d (0x7f83d65fc77d in /home/user/install/bin/miniconda3/envs/epic-models-plus/lib/python3.8/site-packages/torch/lib/libc10.so)frame #1: c10::cuda::CUDACachingAllocator::raw_delete(void*) + 0x1130 (0x7f83d684d370 in /home/user/install/bin/miniconda3/envs/epic-models-plus/lib/python3.8/site-packages/torch/lib/libc10_cuda.so)frame #2: c10::TensorImpl::release_resources() + 0x4d (0x7f83d65e8b1d in /home/user/install/bin/miniconda3/envs/epic-models-plus/lib/python3.8/site-packages/torch/lib/libc10.so)frame #3: <unknown function> + 0x53956b (0x7f840fe7956b in /home/user/install/bin/miniconda3/envs/epic-models-plus/lib/python3.8/site-packages/torch/lib/libtorch_python.so)
<omitting python frames>

RuntimeError('DataLoader worker (pid(s) 13152) exited unexpectedly')
> /home/user/install/bin/miniconda3/envs/epic-models-plus/lib/python3.8/site-packages/torch/utils/data/dataloader.py(792)_try_get_data()
    791                 pids_str = ', '.join(str(w.pid) for w in failed_workers)
--> 792                 raise RuntimeError('DataLoader worker (pid(s) {}) exited unexpectedly'.format(pids_str))
    793             if isinstance(e, queue.Empty)

Cheers,
Victor