Once we have people engaged in scenes, the time differences will become less of a problem.  Bringing the characters back into the 'main' areas will just require agreeing on in what condition they'll leave the 'side scene'.