Yes, it looks good!
What is print(device) saying?
The workload might be a bit small to fully utilize your GPU.
You could increase the number of parameters in your model (conv filters, linear weights) and you’ll probably see some performance gain.