Ask HN: What projects are you working on now?
Log storage and search system for structured logging data in Rust.<p>i.e a database optimised for logs and log-like data and nothing else.<p>Existing solutions are too inefficient for the use case of logs (TB+&#x2F;day), suffer under high field cardinality, are based on costly and unnecessary full-text-search systems that aren&#x27;t well optimised for logs data or just plain and simply can&#x27;t handle structured data and degrade to simply storing lines.<p>Design goals are super efficient&#x2F;fast, extremely fast distributed regex matching backed by trigram bitmap indices, columnar storage for compression and cardinality reasons.<p>I have a prototype of the indexer and lowest levels of the query engine and regex syntax to trigram query optimiser. Will be adding the ingress and query frontends hopefully have something to show soon.<p>I don&#x27;t know if I am going to go OSS or not but definitely designed to be run on-premise though I could easily run it as a multi-tenant service if people are interested.<p>I founded my own startup in the past and have been putting off actually doing a real side-project for the last couple of years but could never get away from the itch so this is going to be my swing I think.<p>If this is something you find interesting hit me up, or if you are just frustrated with ELK for some reason or another let me know what you think sucks and I&#x27;ll try build something that sucks less at that.