born in miami, florida, jackson joined duke ellington alumnus cootie williams's band in 1949 as a teenager, after being discovered by eddie vinson. during the 1950s jackson participated in r&b and jazz recordings, primarily as a session musician. he also toured as leader of the backing band of singer ruth brown whom he married . in the biography of ruth brown however is no mentioning of willes jackson. there it is mentioned that she was marries to trumpeter jimmy brown. jackson joined prestige records in 1959, making a string of jazz albums that proved to an influence on the burgeoning soul jazz movement. during this era, jack mcduff and pat martino became famous through association with jackson. jackson's main influences were lester young and illinois jacquet.