Here, it is likely to get an error, which is shown below. The reason is the current version of Scala is incompatible with ArchiveSpark. Kernel version: 0.1.0.dev6-incubating-SNAPSHOT Scala version: 2.10.4 Exception in thread "main" java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet; Replace the Original Scala Here, we need to build a correct version of Scala to replace the one. To achieve this goal, Docker and sbt should be installed to do the compiling job. 1. Install Docker 1.7.1 sudo rpm -iUvh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm sudo yum update -y sudo yum -y install docker-io sudo service docker start 2. Install sbt sudo curl https://bintray.com/sbt/rpm/rpm | sudo tee /etc/yum.repos.d/bintray-sbt-rpm.repo sudo yum install sbt 3. Download and extract incubator-toree 4. Build the correct version and replace the old one cd sudo make dev sudo cp target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar ~/.ipython/kernels/archivespark/toree/lib/toree-assembly-0.1.0.dev6-incubating-SNAPSHOT.jar After completing the above steps, developers should be able to run ArchiveSpark with Jupyter. We will add more details for the installation by using other IDEs later. Tutorials for Deploying ArchiveSpark in IntelliJ It is easy to deploy ArchiveSpark in IntelliJ. Before that, we need to install JDK 8, and then install Spark and Scala plugins in IntelliJ. For installing JDK 8, please follow the steps in Section 7.3.1.
Here, it is likely to get an error, which is shown below. The reason is the current version of Scala is incompatible with ArchiveSpark. Kernel version: 0.1.0.dev6-incubating-SNAPSHOT Scala version: 2.10.4 Exception in thread "main" java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet; Replace the Original Scala Here, we need to build a correct version of Scala to replace the one. To achieve this goal, Docker and sbt should be installed to do the compiling job. 1. Install Docker 1.7.1 sudo rpm -iUvh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm sudo yum update -y sudo yum -y install docker-io sudo service docker start 2. Install sbt sudo curl https://bintray.com/sbt/rpm/rpm | sudo tee /etc/yum.repos.d/bintray-sbt-rpm.repo sudo yum install sbt 3. Download and extract incubator-toree 4. Build the correct version and replace the old one cd sudo make dev sudo cp target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar ~/.ipython/kernels/archivespark/toree/lib/toree-assembly-0.1.0.dev6-incubating-SNAPSHOT.jar After completing the above steps, developers should be able to run ArchiveSpark with Jupyter. We will add more details for the installation by using other IDEs later. Tutorials for Deploying ArchiveSpark in IntelliJ It is easy to deploy ArchiveSpark in IntelliJ. Before that, we need to install JDK 8, and then install Spark and Scala plugins in IntelliJ. For installing JDK 8, please follow the steps in Section 7.3.1.