Ah, I get it now. Thanks for the explanation. This is the problem with the &quot;deep web&quot; not being indexable by crawlers. I&#x27;ve started looking at how to make this easier for users. Basically I&#x27;m got some ways to detect which sites should be searched in response to your queries, based on the category of words in your query and the site. But then I need to do a real-time search of that site, that might require JS to run, extract the links, and present them back to the user. It might be slow, but it&#x27;s easier for the user to wait for the cloud to do it than click the links on multiple sites himself.<p>Thanks for checking out my site. If you have any questions or have any trouble please let me know at help@solveforall.com. And maybe we can explore brainstorming&#x2F;collaborating since you&#x27;ve clearly put a lot of thought into search.