 His mother, Elizabeth Amherst Hale, was the sister of Lord William Pitt Amherst.Hale was educated in England and returned to Lower Canada in 1820, where he was named secretary to the auditor general for the province.From 1823 to 1828, he was secretary to his uncle, Lord Amherst, in India.