Born in Portsmouth, he was the son of William John Madden (1757–1833), a Captain in the Royal Marines of Irish origin, and his wife Sarah Carter (1759–1833). From his childhood he displayed a flair for linguistic and antiquarian studies. In 1826 he was engaged by the British Museum to assist in the preparation of the classified catalogue of printed books, and in 1828 he became assistant keeper of manuscripts.