Hi HN, this is a personal project I&#x27;ve been working on for some time. This is an amalgam of several good ideas in core.async [1] and durable-queue [2]. There&#x27;s a fuller description here: <a href="http:&#x2F;&#x2F;blog.shriphani.com&#x2F;2016&#x2F;01&#x2F;25&#x2F;pegasus-a-modular-durable-web-crawler-for-clojure&#x2F;" rel="nofollow">http:&#x2F;&#x2F;blog.shriphani.com&#x2F;2016&#x2F;01&#x2F;25&#x2F;pegasus-a-modular-durab...</a><p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;clojure&#x2F;core.async" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;clojure&#x2F;core.async</a>
[2] <a href="https:&#x2F;&#x2F;github.com&#x2F;Factual&#x2F;durable-queue" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;Factual&#x2F;durable-queue</a>