The festival 's recent history owes much to Mr. Boulez and Esa-Pekka Salonen , the music director of the Los Angeles Philharmonic , both of whom put forward tough programs of new music that most classical-music audiences would not abide and that Ojai audiences -LRB- 60 percent of them from Los Angeles -RRB- devoured .