His siblings included brothers Robert and Harold, and sisters Mary and Dorothy Jean.[3] His family grew up in the house built in 1908 by his maternal grandfather Louis Napoleon Nelson. As Nelson lived until 1934, Winbush had a few years as a young boy to absorb his vivid first-person accounts of slavery and service with the Confederate Army during the American Civil War.