 Patterson was born on September 17, 1859 on his family's Kings Valley estate in rural Benton County, Oregon.His parents, Francis A. and Caroline ("née" Tatum) were emigrants to the Oregon Territory, having made the overland trip from their previous home of Bellevue, Illinois.Until he reached the age of 18, he worked his father's farm.