 Stump was born on Oakington Farm in Harford County, Maryland, the son of John Wilson Stump and Sarah (Biays) Stump.He was educated by private tutors and attended Delaware College.Stump studied law with his cousin Henry W. Archer, was admitted to the bar in 1856, and commenced practice in Bel Air.