Thanks for your reply.
From my short experience working with THCudaTensors, they seem to have identical characteristics with cudaMalloc-ed arrays. Are they actually the same? If not, what are the differences? Also, do you have URL to documentations to THCudaTensors?