 Educated privately, he entered Trinity College, Cambridge, in 1836, graduating as Senior Wrangler in 1840 and elected Fellow of Trinity shortly afterwards.Although he had also entered the Inner Temple in 1838, was called to the bar in 1840, and later helped William Whewell with jurisprudence, Ellis never practised law.He hoped unsuccessfully for the Cambridge chair of civil law.