 Because of the general ire of the Plymouth Colony against his father, he had moved to the New Haven Colony.As a result of the upheavals of losing his mother and his father moving away, the young Allerton became a member of the extended family of his grandfather William Brewster and eventually joined the family of his uncle Love Brewster.His aunt Sarah Allerton was married to Degory Priest who was a signer of the Mayflower Compact, and one of the original 102 Pilgrims who arrived on the "Mayflower" to Plymouth, Massachusetts in 1620.