brown's early childhood was spent on a farm on whiskey bottom road in howard county, maryland. he was educated at waterford oaks elementary and dunbar high school, where he graduated as the top student. he received a scholarship to attend williams college in massachusetts. graduating from williams phi beta kappa in 1922, he continued his studies at harvard university, receiving an ma a year later.