beaupreda:

You might want to make sure that torch.cuda.is_available() returns True . I tried your code and it went on my GPU no problem, so you may not be using yours.


This is one possibility, however I also think you cannot achieve a high utilization on the GPU with such a tiny model, so I would assume to see only a few spikes for this workload.