Data, Data Engineer, Open Source, Spark, Kubernetes.
spark.sql.codegen.wholeStage= "false" Error 3 ERROR SparkContext: Error initializing SparkContext. java.nio.file.FileSystemException: /tmp/spark-* -> /tmp/spark-*: No space left on device This happens when the java directory used for temporary files gets filled up and is not being cleaned. To fix