Data Science, Analytics, Databricks, Data Cleaning.
cleaning and transformation steps using PySpark as well as more complex transformations. The example dataset we will be transforming has the following schema and is composed of 4 columns and 990 rows. You find the example dataset in my github repository here. In Part 1 we will upload the example