Konplete fraz sa a: Nan 1813, Ruffin marye Susan Hutchings Travis nan Williamsburg. Koup la demenaje ale rete nan yon plantasyon ke Ruffin eritye nan men granpapa li, nan Coggin's Point, ansanm larivyè Lefrat la James nan Prince George County, ki te note kòm pwen an depa nan Benedict Arnold apre li te chanje lwayote ak anvayi ansanm larivyè Lefrat la James (ki gen ladan Richmond) nan 1781. Yo te gen onz timoun anvan Susan Ruffin te mouri nan 1846, byenke pi fò ta mouri anvan Lagè Sivil Ameriken an te fini ak papa yo te komèt swisid: Edmund Ruffin Jr. (1814-1875), Agnes Ruffin Beckwith (1816-1865), Julian Calx Ruffin (1821-1864, ki te mouri nan
Batay Bluff Drewry a), Elizabeth Ruffin Sayre (1821-1860), Rebecca Ruffin Bland (1823-1855), Jane Ruffin Dupuy (1829-1855), Charles Lorraine Ruffin (1832-1870; VMI gradye ki te siviv lagè a), Ella Ruffin (1832-1855), Ann Ruffin (1844-1863) ak George Chanpyon Ruffin (1845-1913).