scarborough was born in mount carmel, texas. at the age of four she moved to sweetwater, texas for her mother's health, as her mother needed the drier climate. the family soon left sweetwater in 1887, so that the scarborough children could get a good education at baylor college.