 After high school Brown left the South.Although he lived much of his adult life elsewhere, he maintained his connection to the region both in his artwork and research, and later with his plan to purchase the "Rock House" in Beulah, Alabama.During childhood Brown was close with his grandparents, especially his great-grandmother, Mammy.