Different GPU architectures (in combination with different CUDA versions) might use different memory footprints for the CUDA context.
What is the unit of the torch.cuda.memory... output?
1.7GB are too much for the context alone on a V100 and it should be around ~800-1000MB.