Spark, Scala, Java, Big Data, Data Science.
additional dependencies, they need to be included in the fat JAR so that the code can use them. Please note that after marking spark-core and spark-sql as provided, the JAR cannot be run directly in local mode due to the absence of these dependencies. To do so, remove provided, build the assembly