Solved by ptrblck in post #2 
              
              
                Could you return the round operation and check the memory again? 
If the GPU is not being used, then 
device = 'cuda'
model.to(device)

should raise an error. 
For small models and workloads, you might see a low GPU utilization.