Ott was born in Scranton, Pennsylvania in 1926 to Irene and Lester Ott (vice president of W. T. Grant). Ott was born with retinitis pigmentosa, a hereditary degenerative eye disease that leads almost inevitably to blindness. In spite of this, Ott's father Lester encouraged him to pursue his interest in painting.