Philip Johnson , at once the elder statesman and the enfant terrible of American architecture , died Tuesday at the compound surrounding the Glass House , the celebrated residence he built for himself in New Canaan , Conn. .