The memory of input1 and input2 is already on GPU.
If you see https://github.com/sniklaus/pytorch-extension/blob/master/src/HadamardProduct_kernel.cu#L25-L26 47
The input is a THCudaTensor, which is a GPU tensor.
PyTorch does not use UVA addressing.