 Harvey was born in Shellman, Georgia.He attended Randolph-Clay High School in Cuthbert, Georgia where he was the consensus 1999 national high school player of the year.In 1999, he was in the McDonald's All-America Game, was in the USA Today All-USA 1st Team in 1999, and got the Naismith Award as nation's top high school player in 1999.