Data Governance, Data Warehouse, Databricks, Databricks Sql, Data Observability.
can also be found in the query profiler UI (Make sure to set the “include_metrics” flag as True when calling the API so that it returns these metrics). With the Databricks Python SDK we can create a notebook which pulls all the queries that have been run within the last hour. #import and setup the