Hi,
Could you run the code with CUDA_LAUNCH_BLOCKING=1 and give here the stack trace you’re getting?
This is due to invalid indexing of a cuda tensor. This can be caused for example if some of your ground truth labels are larger than the number of labels.