 Miles was born in Nice, France, the daughter of Jeanne Patterson Miles, an American painter, and Johannes Schiefer, a French painter and art curator.She immigrated to the United States, and was naturalized a citizen, in 1941.She graduated from The Putney School, a progressive independent high school in Putney, Vermont, in 1958.