Hi,
You can print the inputs before feeding them to the model to make sure they are on the gpu.
It is possible that your model is so small that the gpu is barely used as well, you can try increasing the batch size to see if the gpu usage increases.