 Noel married Augusta Mary, daughter of Henry Cecil Lowther, on 30 June 1863.At his home, Catmose House, in Oakham, Rutland, he developed a fine garden which employed 15 gardeners.Noel died in May 1911, aged 87.