Depending on the way you’ve installed PyTorch, either your local CUDA toolkit (if you’ve built PyTorch from source) or the shipped CUDA runtime will be used (if you’ve installed the conda binaries or pip wheels).
I’m not familiar with the “Deep Daze” and “Big Sleep” implementations and don’t know, if custom CUDA extensions are used. If so, then you would also need a working local CUDA toolkit in order to be able to compile it.
In any way, are you able to use the GPU in a PyTorch-only script?