ashby was born in lubbock, texas and graduated from monterey high school. he played college baseball at texas tech university and was all-region in 1976 and all-american in 1977. he was drafted by the san diego padres in the 22nd round of the 1977 major league baseball amateur draft.