you are giving an out of bounds index somewhere.
Can you reproduce this error with a small snippet?
Usually these device-side asserts are easier to debug if you run the same code on CPU (i.e. without .cuda()) and you know right away what the out of bounds indices are and where they’re coming from.