as much as it pained him to see the orchestra in decline , and even in danger due to the unfortunate decisions that had been made since his departure as conductor and music director , there was only so much he could do .