your understand is correct, it will chunk data based on dim=0 in default
I’m not sure transposing it recommended way, but contiguous() will cause copy
I think nn.DataParallel(mod.to(device)) is better