unfortunately one these below needs to be successful to shift the model to GPU otherwise it’s just a CPU based model. If u can post sample code for others to debug that would help
(1) model.cuda() 
(2) model.to(‘cuda’)