born into an impoverished family, williams was raised by his brother edgar after the death of both his parents as a child, and, after edgar's death, by an aunt. despite his background, williams was able to be a successful high school football player, and was able to enroll at east carolina university. after graduating from east carolina, williams was signed by the memphis showboats of the united states football league. while playing in memphis, future professional football hall of famer reggie white gave the shifty williams the nickname "gizmo", which would stick with him through his professional career.