Even though nvidia-smi shows pytorch still uses 2GB of GPU memory, but it could be reused if needed.
After del try:
a_2GB_torch_gpu_2 = a_2GB_torch.cuda()
a_2GB_torch_gpu_3 = a_2GB_torch.cuda()  

you’ll find it out.