Is it possible to disable this functionality so I can call all reduce manually?

Do you need to implement any customized logic in allreduce? If so, I will recommend DDP comm hooks 1, which provides an interface to implement customized allreduce.
Another option is no_sync context manager 6, which will disable allreduce, then it’s your responsibility to run allreduce.