moved labels to the same device as logits for BLOOM, GPT Neo, GPT NeoX, RoBERTa and VIT models
# What does this PR do?

As suggested in the https://github.com/huggingface/transformers/issues/22561, moved labels to the same device as logits for `BLOOM`, `GPT Neo`, `GPT NeoX`, `RoBERTa` and `VIT` models.

@sgugger Could you review this once?
_The documentation is not available anymore as the PR was closed or merged._