Hi there,
I have a huge tensor (Gb level) on GPU and I want to convert it to float16 to save some GPU memory. How could I achieve this?
I tried
a_fp16 = a.to(torch.float16)

But it actually reserves another memory block to save the fp16 tensor and the fp32 tensor is still there.
I also tried
del a

after casting. But the memory is not released.
Thanks