madison married nelly conway (port conway, caroline county, virginia, january 9, 1731 – montpelier, orange county, virginia, february 11, 1829), also of the planter class (her birthplace was named after her family). they had twelve children: