Without seeing the complete network I can’t tell. However, a number of things can be different between batch size 1 and batch size 2. E.g., tensors that are contiguous with batch size 1 might not be with larger batch size.