The bulk of the town's downtown and older residential area are included in the Mount Carroll Historic District, which encompasses 118 acres and was entered into the National Register of Historic Places in 1980.