Assembly Speaker Sheldon Silver , a Manhattan Democrat , continued to express concerns that the office space to be built as part of a broader plan to transform the area around the stadium would compete with office space to be built in Lower Manhattan to restore the area after the Sept. 11 attack .