Colonel Barrett's troops, upon seeing smoke rising from the village square as the British burned cannon carriages, and seeing only a few light infantry companies directly below them, decided to march back toward the town from their vantage point on Punkatasset Hill to a lower, closer flat hilltop about 300 yards from the North Bridge.