 His parents London and Martha Payne were part of the "Brown Elite" of free blacks in the city.Both died before he reached maturity.While his great-aunt assumed Daniel's care, the Minors' Moralist Society assisted his early education.