If you are transferring the data to the GPU via model.cuda() or model.to('cuda'), the GPU will be used. Otherwise an error would be raised.
A low GPU utilization might come from different bottlenecks in your code, e.g. the data loading.
As a quick check you could run a simple matrix multiplication on the GPU in a loop and should see some GPU utilization in nvidia-smi.