Could you return the round operation and check the memory again?
If the GPU is not being used, then
device = 'cuda'
model.to(device)

should raise an error.
For small models and workloads, you might see a low GPU utilization.