Barkley was born and raised in Leeds, Alabama, 10 miles outside Birmingham. He was the first black baby born at a segregated, all-white town hospital and was in the first group of black students at his elementary school.[12] His parents divorced when he was young after his father abandoned the family, which included younger brother Darryl Barkley. His mother remarried and they had a son, John Glenn.