Still , he asserted , white restaurateurs like Danny Meyer -- who started the Union Square Cafe and a succession of other Manhattan restaurants -- have little trouble opening restaurants in New York , yet the Woods family , which runs the popular Sylvia 's Restaurant in Harlem , still has only one restaurant in New York .