I’m assuming that since your tensor of shape 195HW is a single training example, you don’t want it to be split by N GPUs, since 195 is not the batch size in this case? If you pass in your training examples in the form such as batch_size * C * H * W for example then DataParallel/DDP should divide along the batch size dim.
Could you potentially paste a reproduction of this issue and the associated error message that you get?
Btw, if you are using utilities provided by PyTorch such as the DataLoader  you can configure the drop_last argument to ensure that batch sizes are even.