he was born in 1820 in alabama to parents luke pryor and ann batte lane. his father's first marriage was to martha scott, a sister of general winfield scott. his brother was the noted race horse trainer john benjamin pryor of natchez, mississippi.