Given my opinion, I think we should press forward for a ways.  Given magic, the group should have a bit of time to recover from the cold after taking some subdual damage from it.  It might be a great advantage to catch the bandits before they can reasonably expect us too.