 Stump was elected to the Maryland State Senate in 1878 and served until 1880.He served as chairman of the state Democratic convention in 1879, and was the Senate's President pro tempore in 1880.In 1888, Stump was elected to the U.S. House of Representatives.