This issue seems to be unrelated to the illegal memory access. Were you able to create the backtrace?
For the 0% utilization: your code might be bottlenecked by the data loading or any other operation. If the GPU has little work to do and is “starving” (waiting for the next input), the utilization might go to 0% in these phases.