richards was born in rural adair county, kentucky, and played basketball for one year at adair county high school. he was recruited to play baseball at western by coach e. a. diddle (better known as the basketball coach). diddle got richards into officiating high school basketball. after graduation, richards was hired as head basketball coach at auburn high school. he went from there to glasgow high, where he coached the scotties to a state championship in 1968.