You mean that our users do not need do anything for the overlap? Previously, I guess maybe something like multiprocessing would be useful 
By the way, could you please give more details or codes for the use of torch.cuda,synchronize() to record times? Thanks very much.