Try to visit during the early morning, before the mass-production artists set up their easels and the crowds take over.
Crowds don't come until later because the morning is reserved for setup time, and most people aren't willing to wake up that early in the morning anyway.