Databricks, Delta Lake, Pyspark, Clustering, Data Warehouse.
Liquid clustering is incremental, meaning that data is only rewritten as necessary to accommodate data that needs to be clustered. For tables experiencing many updates or inserts, Databricks recommends scheduling a OPTIMIZE job every one or two hours. Because liquid clustering is incremental, most