 Born in Birmingham, Alabama, Hill was the son of Mary Lee Hill, who raised him and his sister Toni, alone.In the 1940s, Hill moved with his mother and sister to Washington, D.C. Hill attended Cardozo High School, graduating in 1949.Hill had wished to attend Howard University, but was not able due to strained financial resources.