This should work and would print the shape of each chunk of the input batch:
def forward(self, x):
    print(x.shape, x.device)
    ...

If you are printing the tensor outside of the forward, you won’t see any difference to a single GPU run.