Oh what I was asking was if the memory allocated through THCuda  package  would reside in the device‘s main  memory and display the same caching behavior as memory allocated via cudaMalloc.
Thanks for letting me know about  A different package.  I will definitely take a look.  Will it be compatible with pytorch 1.0 ?