 Munroe was born to Thomas and Ellen Middleton Munroe at their family home on 22nd Street near 4th Avenue in New York City on April 3, 1851.Munroe's grandfather was William Munroe who made the first American lead pencils in 1812.In 1854, the Munroe family moved to Clifton, Staten Island where Munroe spent his childhood.