Capture Visible Webpage Content (or text) as if Copying from Browser
Sure. Use Selenium and just loop through all visible, displayable elements.
Is there a way to capture visible webpage content or text as if copying from a browser display to parse later (maybe using regular expression etc)? I don't mean to clean the html tags, javascript, etc and only show leftover text.  I would like to copy all visible text, since some style elements may hide some of the html text while showing others when displayed in the browser.  So far I have looked into nltk, lxml Cleaner, and selenium without luck.  Maybe I can capture a screenshot in selenium and then extract text using ocr, but that seems computer intensive?  Thanks for any help!