Profile your code and check if your workload is e.g. CPU-bound (you should see whitespaces between the CUDA kernels). If so, increasing the batch size would increase the GPU utilization since the CPU would have more time to run ahead with the scheduling.
I don’t know what @DeuS_CaNoN is referring to regarding the driver.