Alternative to a server side scripting language for scraping
Given the server limitation, I would run those scripts locally to generate HTML, and push that static output onto your server.
I have a small website hosted by my university. The policy is that no server side scripting language (e.g. PHP, etc.) is enabled, hence websites are either static or can use client side scripting (e.g. javascript, etc.). I also can't touch the server/configure it/install things.
Anyway, I wanted to add some data from other websites (namely, google scholar citations) that I manage to scrape with Python+lxml, dynamically.
Is there any way I can have these data dynamically queried - on the client side of course?
I tried using IronPython to embed my Python code in my webpage, but it was complaining about failing to find the lxml imported library. But a similar solution would be great.
Or a library in pure javascript which allows for opening and parsing external webpages...?
Thanks!