The original 600 works in the permanent collection grew to about 1,300 with the opening of the second building in 1954. This number grew to around 2,000 following its move to the Breuer building on Madison Avenue in 1966. It began collecting photography in 1991.