Costle was born in Long Beach, California. He studied at Harvard University and at the University of Chicago. Costle died on January 13, 2019 in McLean, Virginia from complications of a stroke, aged 79.