Nobody has the right to assemble on someone else's private property.  Moreover, even with public property, the right to peacefully assemble seems to be not without restraint.  For instance, the courts have upheld laws creating "buffer zones" for abortion clinic protests.  Likewise, a lot of cities require you to get a permit for demonstration purposes.