Extracting Spark tar The following command for extracting the spark tar file. $ tar xvf spark-1.3.1-bin-hadoop2.6.tgz Moving Spark software files The following commands for moving the Spark software files to respective directory (/usr/local/spark). $ su – Password: # cd /home/Hadoop/Downloads/ # mv spark-1.3.1-bin-hadoop2.6 /usr/local/spark # exit Setting up the environment for Spark Add the following line to ~/.bashrc file. That adds the location, where the spark software files are located to the PATH variable. export PATH = $PATH:/usr/local/spark/bin Use the following command for sourcing the ~/.bashrc file. $ source ~/.bashrc Step 7: Verifying the Spark Installation Write the following command for opening the Spark shell. $spark-shell If Spark is installed successfully then you will find the following output. Spark assembly has been built with Hive, including Datanucleus jars on classpath Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 15/06/04 15:25:22 INFO SecurityManager: Changing view acls to: hadoop 15/06/04 15:25:22 INFO SecurityManager: Changing modify acls to: hadoop 15/06/04 15:25:22 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); users with modify permissions:
Extracting Spark tar The following command for extracting the spark tar file. $ tar xvf spark-1.3.1-bin-hadoop2.6.tgz Moving Spark software files The following commands for moving the Spark software files to respective directory (/usr/local/spark). $ su – Password: # cd /home/Hadoop/Downloads/ # mv spark-1.3.1-bin-hadoop2.6 /usr/local/spark # exit Setting up the environment for Spark Add the following line to ~/.bashrc file. That adds the location, where the spark software files are located to the PATH variable. export PATH = $PATH:/usr/local/spark/bin Use the following command for sourcing the ~/.bashrc file. $ source ~/.bashrc Step 7: Verifying the Spark Installation Write the following command for opening the Spark shell. $spark-shell If Spark is installed successfully then you will find the following output. Spark assembly has been built with Hive, including Datanucleus jars on classpath Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 15/06/04 15:25:22 INFO SecurityManager: Changing view acls to: hadoop 15/06/04 15:25:22 INFO SecurityManager: Changing modify acls to: hadoop 15/06/04 15:25:22 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); users with modify permissions: