Data Governance, Data Warehouse, Databricks, Databricks Sql, Data Observability.
memory or there is a significant skew in the data. The below query uses our ingested query history table to return the count of queries that are spilling to disk and by how much with average and max values. select avg(metrics.spill_to_disk_bytes) as avg_spill_to_disk_bytes,