The utilization gives the percentage of executing kernels during a time frame. It neither gives you the percentage of used memory nor the percentage of busy multiprocessors.


You could try to increase the batch size with by a smaller amount and try to max out the memory.
However, not that too large batch sizes might yield worse results for your model, so you might want to experiment with the batch size a bit.