Three projects in which he had a keen interest -- bringing the Olympics to New York City , putting a football stadium on the West Side and building the Freedom Tower in Lower Manhattan -- have either failed or been mired in controversy .