I have 4 gpus available, out of which i have selected the second one using
if torch.cuda.is_available():
    torch.cuda.set_device(2)

However when i compute the TrainingArgument() command :
training_args = TrainingArguments('mydirectory')
then torch.cuda.current_device(). is giving 0
Any idea why this is happening?