Crawl live website and do a text/code search? I need a Mac app that can crawl a live website and do a text search (and, as a bonus, a source code search) and report the results. 

Surely something like this exists. Help!
When I needed to do this I used AppleScript to feed the text to BBEdit which has a full POSIX regex and excellent AppleScript support. You can probably do it with Automator as well and simply use due shellscript to pipe the text through your regex.