After graduating from Harvard and MIT, he served an apprenticeship with Boston architects William Robert Ware & Henry Van Brunt and William Ralph Emerson, respectively. Silsbee traveled around Europe before moving to Syracuse, New York in 1874. In 1875, he married Anna Baldwin Sedgwick, daughter of influential lawyer and politician Charles Baldwin Sedgwick.