Fix `GitModelIntegrationTest.test_batched_generation` device issue
# What does this PR do?

In PR #21282, `input_ids` is not on the target device and CI fails with

```bash
E       RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper__index_select)
```
_The documentation is not available anymore as the PR was closed or merged._