Data Science, Analytics, Databricks, Data Cleaning.
non_null_user_ids, count(user_id) - count(distinct(user_id)) as difference from users_raw; To remove all duplicates we use the following query. CREATE OR REPLACE TEMP VIEW users_clean AS SELECT user_id, user_first_touch_timestamp, max(email) AS email, max(updated) AS updated FROM users_dirty WHERE