We faced a very similar problem when we started Kentik two years ago, except in our case the &quot;transactions&quot; are network traffic telemetry that we collect from our customers&#x27; physical network infrastructure, and providing super-fast ad hoc queries over that data is our core service offering.<p>We looked at just about every open source and commercial platform that we might use as a backend, and decided that none were appropriate, for scale, maturity, or fairness &#x2F; scheduling.  So we ended up building, from scratch, something that looks a bit like Google&#x27;s Dremel &#x2F; BigQuery, but runs on our own bare metal infrastructure.  And then we put postgres on top of that using Foreign Data Wrappers so we could write standard SQL queries against it.<p>Some blog posts about the nuts and bolts you might find interesting:<p><a href="https:&#x2F;&#x2F;www.kentik.com&#x2F;postgresql-foreign-data-wrappers&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.kentik.com&#x2F;postgresql-foreign-data-wrappers&#x2F;</a><p><a href="https:&#x2F;&#x2F;www.kentik.com&#x2F;metrics-for-microservices&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.kentik.com&#x2F;metrics-for-microservices&#x2F;</a><p>If we were starting today, we might consider Apache Drill, although I haven&#x27;t looked at the maturity and stability of that project recently.