thyeros:

In that sense, can I say b) is more memory efficient?


No, as the transposes should be views and the memory allocations should thus also be identical as seen via print(torch.cuda.memory_summary()).