Durley and the TCU coaching staff agreed that it was best for Aaron to take a break from basketball for the sake of his long-term health. Aaron graduated from TCU with a major in Sports Broadcasting in May 2016. His brother Cameron Durley participated in the 2008 Little League World Series, also as a member of the Dhahran, Saudi Arabia team. Cameron was 6'2" and 228 lbs. at 12 years of age at the time. His grandfather, Wilson Graham, played college basketball in Ohio, and his father played at East Texas State. His aunt is former WNBA player Margo Graham.