Price was born near Farmville, in Prince Edward County, Virginia. His family was of Welsh origin. Price attended Hampden-Sydney College in 1826 and 1827, studying law and working at the courthouse near his home. He was admitted to the Virginia bar and opened a law practice.