A crude test you can try is to simply inspect the amount of GPU memory used in something like nvidia-smi or gpustat. If the memory usage is not increasing, then something is suspicious. Alternatively, you can try increasing the batch sizes until you run out of GPU memory (which should happen).