Yes, this seems to be the same issue!
After doing more testing it seems that the amount of memory allocated after calling torch.cuda.init()  depends on the numbers of GPUs visible. (With 1xP100 about 10GB is allocated. With 2xP100 about 18GB is allocated…)
Did you find any workarounds for this issue?