RethinkDB versus PostgreSQL: my personal experience
I appreciate the detailed analysis.  A few comments:<p>&gt; This post is probably going to make some people involved with RethinkDB very angry at me.<p>Actually, our community has always felt the opposite. Performance and scalability issues are considered bugs worth solving. That may have been the reaction of one or two community members, but that doesn&#x27;t represent our values at all.<p>&gt; A RethinkDB employee told me he thought I was their biggest user in terms of how hard I was pushing RethinkDB.<p>This may have been true (at the time) in terms of how SMC was using changefeeds, but RethinkDB is used in far more aggressive contexts. Here&#x27;s a talk from Fidelity about how they used RethinkDB (for 25M customers across 25 nodes): <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=rm2zerSz6aE" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=rm2zerSz6aE</a><p>SMC did seem to uncover a number of surprising bugs along the way: I would describe it as one of the more forward-thinking use cases that pushed the envelope of some of RethinkDB&#x27;s newest features. This definitely came with lots of performance issues to solve along the way. I appreciate William’s tenacity and patience in helping us track down and fix these along the way.<p>&gt; In particular, he pointed out this 2015 blog post, in which RethinkDB is consistently 5x-10x slower than MongoDB.<p>It’s worth pointing out that this particular blog post raised serious questions in its methodology, and recent versions of RethinkDB included very significant performance improvements: <a href="https:&#x2F;&#x2F;github.com&#x2F;rethinkdb&#x2F;rethinkdb&#x2F;issues&#x2F;4282" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;rethinkdb&#x2F;rethinkdb&#x2F;issues&#x2F;4282</a><p>&gt;  Even then, the proxy nodes would often run at relatively high cpu usage. I never understood why.<p>I&#x27;d have to double-check with those who are far more familiar with RethinkDB&#x27;s proxy mode, but it&#x27;s because the nodes are parsing and processing queries as well, which can be CPU-intensive. They don&#x27;t store any data, but if you use ReQL queries in a complex fashion (especially paired with changefeeds) it&#x27;s going to require more CPU usage. We generally recommend that you run nodes with a lot of cores to take advantage of the parallelized architecture that RethinkDB has. This can get expensive if you aren&#x27;t running dedicated hardware.<p>&gt; The total disk space usage was an order of magnitude less (800GB versus 80GB).<p>RethinkDB doesn&#x27;t yet have compression (<a href="https:&#x2F;&#x2F;github.com&#x2F;rethinkdb&#x2F;rethinkdb&#x2F;issues&#x2F;1396" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;rethinkdb&#x2F;rethinkdb&#x2F;issues&#x2F;1396</a>). Between this fact and running 1&#x2F;3 the number of replicas, the reduced disk usage is not surprising.<p>&gt; I imagine databases are similar. Using 10x more disk space means 10x more reading and writing to disk, and disk is (way more than) 10x slower than RAM…<p>This isn&#x27;t necessarily true, especially with SSDs. RethinkDB&#x27;s storage engine neatly divides its storage into extents that can be logically accessed in an efficient fashion. This is particularly valuable when running on SSDs, which are fundamentally parallelized devices. RethinkDB also caches data in memory as much as possible to avoid going to disk, but using more disk space doesn&#x27;t immediately translate to lower performance.<p>One other interesting detail: since RethinkDB doesn’t have schemas, it stores the field names of each document individually. This is one of the trade-offs of not having a schema: even with compression, RethinkDB would use more space than Postgres for this reason. (This also impacts performance, since schemaless data is more complicated to parse and process.)<p>&gt; Not listening to users is perhaps not the best approach to building quality software. [referring to microbenchmarks]<p>I think William may have misinterpreted the quote he describes from Slava’s post-mortem. Slava was referring to benchmarks that don’t affect the core performance of the database or production quality of the system, but may look better when you run micro-benchmarks: <a href="https:&#x2F;&#x2F;rethinkdb.com&#x2F;blog&#x2F;the-benchmark-youre-reading-is-probably-wrong&#x2F;" rel="nofollow">https:&#x2F;&#x2F;rethinkdb.com&#x2F;blog&#x2F;the-benchmark-youre-reading-is-pr...</a><p>We have always had an open development process on GitHub to collaboratively decide what features to build, and what their implementation should look like. I’m not certain what design choices William is suggesting we rejected. One has to only look at the proposal for dates and times in RethinkDB to see how this process and open conversation unfolds with our users: <a href="https:&#x2F;&#x2F;github.com&#x2F;rethinkdb&#x2F;rethinkdb&#x2F;issues&#x2F;977" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;rethinkdb&#x2F;rethinkdb&#x2F;issues&#x2F;977</a><p>&gt; Really, what I love is the problems that RethinkDB solved, and where I believed RethinkDB could be 2-3 years from now if brilliant engineers like Daniel Mewes continued to work fulltime on the project.<p>RethinkDB development is proceeding after joining The Linux Foundation, despite the company shutdown. We believe that with a few years of work, RethinkDB will continue to mature as a database to reach Postgres’ level of stability and performance. We’re exploring options for funding dedicated developers long-term as an open-source project.<p>My thoughts: whatever technology you end up picking is going to have tradeoffs depending on your use case (and the maturity of the technology) and it&#x27;s going to come with baggage. That&#x27;s true of Postgres, MongoDB, RethinkDB, any programming language you choose, any tools you pick. If you&#x27;re willing to carry that baggage it can be worth it: especially if it gives you developer velocity or if the problem you&#x27;re solving is particularly well-suited to the tool.<p>Pick the technology that will have the least baggage for your problem. I often recommend Postgres to people, despite being one of the RethinkDB founders. Pragmatism wins over idealism, every time.