Hi,
I  have a basic theoretical question. Which one is better for the model and GPU usage?
First option:
--per_device_train_batch_size 8 
--gradient_accumulation_steps 2

Second option:
--per_device_train_batch_size 16