Wednesday, December 16, 2015

Install Spark - (Linux)

Installing Spark (Archlinux)


Arch linux is my OS of choise so I will start with installing it on it first. The beauty of Arch is it package manager.  It comes from AUR package.


apache_spark is the the name of package. I am using yaourt to install it.

 yaourt -S apache_spark  


This scripts set ups the environment variables.


 /etc/profile.d/apache_spark.sh  


or just add this /usr/lib/apache_spark/bin to the PATH variable

 export PATH=$PATH:/usr/lib/apache_spark/bin  


Running an example to make sure it is working properly:

 run-example SparkPi 10