The batch size is independent from the data loading and is usually chosen as

what works well for your model and training procedure (too small or too large might degrade the final accuracy)
which GPUs you are using and what fits into your device memory. Generally you can increase the device utilization by increasing the workload e.g. through the batch size.