How Google’s Web Crawler Bypasses Paywalls
Solution:Content providers register a (yet-to-be-written) Google News API account, get an API key, with which Google indexes the site and the site recognizes as legit.