Huginn: Create agents that monitor and act on your behalf
It's fun to wake up to find a project that I started on the top of HN! These days, I'm no longer very involved with the day-to-day of the project.<p>Now that it's no longer a young project, here are some musings about Huginn and responses to people's comments in this thread, in no particular order.<p>I've found that Huginn excels as a scheduled web scraper with lightweight filtering. That's what I use it for. On the other hand, while you can write custom code in it, Huginn is pretty poor at implementing any sort of complex logic, and is even worse at bidirectional syncing between systems, which is something people often want it to do, but for which it wasn't designed.<p>If IFTTT or Zapier meet your needs, awesome! No need to run and monitor your own service. I personally choose to run Huginn on my own hardware in large part so that I'm comfortable giving it website cookies and passwords.<p>Some examples of what I use Huginn for these days:<p>- Watching Twitter in realtime for high standard deviation spikes in certain keywords, such as "san francisco emergency" or "san francisco tsunami warning", which then sends me a push notification, or "huginn open source", that goes to a digest email (and I imagine will trigger because of this thread).<p>- Watching Twitter for rare terms and sending me a digest of all tweets that match them. Also sending me all tweets from a few Twitter users who post rarely, but that I don't want to miss.<p>- Scraping a number of rarely updated blogs that don't have email newsletters and emailing me when they change. Some use RSS, most are just simple HTML scraping.<p>- Pulling deals from the frontpage and forums of slickdeals and craigslist and filtering them for certain keywords.<p>- Sending an early morning email if it's going to rain today.<p>- Watching ebay for some rare items.<p>- Sending my wife and me an email on Saturday morning with local yardsales from craigslist.<p>- Watching the HN and producthunt front pages for certain keywords.<p>Basically, anytime I find myself checking a website more then a few times, I spend 20min making a Huginn Agent to do it for me.<p>I think one reason Huginn has worked well for me is that I don't try to make it do too much. I use it for scraping data and gentle filtering, and that's about it. It's been super helpful for alerting me to interesting content for The Orbital Index, my current project, a weekly space-industry newsletter. (Last issue: <a href="http://orbitalindex.com/archive/2019-12-10-Issue-42/" rel="nofollow">http://orbitalindex.com/archive/2019-12-10-Issue-42/</a>)