Install Spark - (Linux)

Installing Spark (Archlinux)

Arch linux is my OS of choise so I will start with installing it on it first. The beauty of Arch is it package manager.  It comes from AUR package.


apache_spark is the the name of package. I am using yaourt to install it.

 yaourt -S apache_spark  

This scripts set ups the environment variables.

 /etc/profile.d/apache_spark.sh  


or just add this /usr/lib/apache_spark/bin to the PATH variable

 export PATH=$PATH:/usr/lib/apache_spark/bin  



Running an example to make sure it is working properly:



 run-example SparkPi 10  

Database Ranking Based on Popularity

Top 5 Databases:

Nov 2015	Oct 2015	Nov 2014	Nov 2015	Oct 2015	Nov 2014
1.	1.	1.	Oracle	Relational DBMS	1480.95	+13.99	+28.82
2.	2.	2.	MySQL	Relational DBMS	1286.84	+7.88	+7.77
3.	3.	3.	Microsoft SQL Server	Relational DBMS	1122.33	-0.90	-97.87
4.	4.	5.	MongoDB	Document store	304.61	+11.34	+59.87
5.	5.	4.	PostgreSQL	Relational DBMS	285.69	+3.56	+28.33

http://db-engines.com/en/ranking

				Top 5 Graph Databases: Rank DBMS Database Model Score Nov 2015 Oct 2015 Nov 2014 Nov 2015 Oct 2015 Nov 2014 1. 1. 1. Neo4j Graph DBMS 34.04 +0.63 +9.39 2. 2. 2. Titan Graph DBMS 6.06 +0.54 +3.45 3. 3. 3. OrientDB Multi-model 5.50 +0.57 +3.48 4. 4. 7. ArangoDB Multi-model 1.61 +0.13 +1.30 5. 5. 6. Giraph Graph DBMS 0.92 -0.00 +0.45

Pregel

What is Pregel?

Inspired by Euler Graph Problem - Seven Brindges of Koningsberg. This is a description of Pregel river now.



Started with a paper by Google in 2010 (here)


Simple explanation



Implementations: