I tried with and without .half() on my model, the outputs of torch.cuda.memory_summary() seem to have no difference on Cur Usage  | Peak Usage | Tot Alloc  | Tot Freed. Could you provide an example model that shows significant memory reduce after set data type to half?
Also, is there an documents explaining the meaning of Allocated memory,  Active memory, GPU reserved memory and  Non-releasable memory? Thanks.