Thanks for you answer.
Actually I have though about your idea, but I wanted to do with same procedures I have done in my previous codes.
BTW, is there any specific code to break out from DataParallel? I was not able to find any.