The problem persists even if SummaryWriter from torch.utils.tensorboard is used . . .
This could have something to do with not detaching the output tensor from the compute graph prior to saving it . . .