I have no problem with the GPU version.
In my case, tested on Unity, I added the line
network.to(at::kCUDA); // If we're doing this on GPU


in the network.cpp file and it worked. I supposed that this should work for UE4 too