 He returned to the House in 1849, where he was elected Speaker by a 38–31 vote, and continued championing railroad construction.In 1851, a sizeable faction of the Democratic Party, angry with the policies of incumbent 1st district congressman Andrew Johnson, convinced Haynes to run against him in the general election (the Whig Party opted not to field a candidate).In what would prove to be one of Johnson's toughest campaigns, the two candidates canvassed the district together, engaging in fierce debates in front of large crowds.