Databases in 2022: A Year in Review
My takes for where databases are going in 2023 and beyond:<p>Separation of storage and compute is clearly the right direction for cloud databases. Pay for what you use. A cache between object storage and compute will paper over the differences and enable supporting workloads that match yesterday&#x27;s and today&#x27;s typical application architectures.<p>Still waiting for a database architecture that embraces the reality of distributed systems &#x2F; concurrent mutation and exposes the right set of tools to reliably hit the theoretically minimum tradeoffs across a wide range of applications. CRDTs for example are making progress here but have not been generalized enough yet.<p>At some point transactional workload volume will grow to what we call &quot;big data&quot; today, and we&#x27;ll be forced to use more storage-efficient columnar data representations for OLTP. I&#x27;m curious to see where &#x27;build your own database kit&#x27;-DataFusion and efficient dataframe tools like polars&#x2F;arrow2 can take us.