I would assume there is no hard-coded dependency on CUDA in the repository so unless you manually push the data and model to the GPU, the CPU should be used.
In case you are using an already provided inference script and cannot see how the GPU is used, mask it via CUDA_VISIBLE_DEVICES="" python inference.py so that PyTorch won’t be able to use it.