Are you using multiple workers in your DataLoader?
Could you share some code of your Dataset and the instantiation of your DataLoader?
Your error might be related to some multi-processing / CUDA issue.