Arlen 's big musical break came after he moved to New York and made his way up to Harlem , where he listened to the jazz legends who performed there late into the night , including Duke Ellington , Louis Armstrong and Fats Waller .