It will depend a lot on your network. But if it is not too big or your dataloader is not fast enough then yes that is expected.
You can try adding workers to the dataloader to make sure this is not the bottleneck. Otherwise increasing the batch size (if you have enough memory) should increase the usage.