Well it would be better to split, I would like to keep things moving at least a bit to keep things fairly fresh in the minds of players. If I recall correctly, it was Nim and Demik's characters that didn't like the idea of trusting the Magistrate, so perhaps the rest of the party sees no 'harm' in going back the next day.