Data Governance, Data Warehouse, Databricks, Databricks Sql, Data Observability.
query histories to dicts queries_as_dicts = [query.as_dict() for query in queries] #create a pandas dataframe and then convert it to a pySpark dataframe queries_pandas = pd.DataFrame(queries_as_dicts) queries_df = spark.createDataFrame(queries_pandas) #add the time window to which the query belongs