Connect with us

Hi, what are you looking for?

Linux

How to Install Apache Spark on Ubuntu 16.04

How to Install Apache Spark on Ubuntu 16.04 / Debian 8 / Linux mint 17. Apache Spark is a flexible and fast solution for large scale data processing. It is an open source distributed engine suitable for large scale data processing. Apache spark was founded by an Apache Software Foundation. It can be run on HBase, Hadoop, Cassandra, Hive, Apache Mesos, Amazon EC2 Cloud, HDFS, etc. It can run using its standalone cluster mode as well as on various cloud platforms.

Step-1 (Add the Java PPA)
# apt-add-repository ppa:webupd8team/java
Step-2 (Install the Java)

Update the apt-get repository

# apt-get update

Install the Java installer

# apt-get install oracle-java8-installer
Step-3 (Install the Scala)

Create the Scala directory

# mkdir /opt/scala

Download the Scala packages

Advertisement. Scroll to continue reading.
# wget http://downloads.lightbend.com/scala/2.12.1/scala-2.12.1.deb

Install the Scala packages

# dpkg -i scala-2.12.1.deb
Step-4 (Install the Apache Spark)

Download the Apache Spark Tarball

# wget http://d3kbcqa49mib13.cloudfront.net/spark-2.0.2-bin-hadoop2.7.tgz

Extract the Apache Spark Tarball

# tar -xvf spark-2.0.2-bin-hadoop2.7.tgz

Copy the extracted packages to /opt/spark

# cp -rv spark-2.0.2-bin-hadoop2.7/* /opt/spark

Change the directory to access Spark Shell

Advertisement. Scroll to continue reading.
# cd /opt/spark

Finally run the Spark Shell from Bash known as Scala Shell

# ./bin/spark-shell --master local[2]

Final Words

That’s all now you have installed the Apache Spark on your Debian based Linux distributions with ease. If you have any issues with above guides you need to use the comment section below.

Comments
Advertisement
Advertisement

Linux

DNF stands Dandified YUM and this is the default package manager for RHEL 8 / CentOS 8.  This tutorial explains you how to create...

Linux

If you forget a root password of your RHEL 8 and CentOS 8 and want to reset the password so that the RHEL 8...

Windows

How to auto upgrade JioFi firmware for JioFi 2 / JioFi 3 / JioFi 4 / JioFi 5 / JioFi 6 and other JioFi...

Linux

How to Upgrade WordPress Server from Ubuntu 16.04 to Ubuntu 18.04. Right now, Ubuntu 18.04 has been released with tons of new features. Upgrading...

Linux

How to Enable TLS 1.3 on Nginx Web Server. Nginx is a ultra fast web server optimized for modern web applications and servers. TLS...

Advertisement

You May Also Like

Windows

How to auto upgrade JioFi firmware for JioFi 2 / JioFi 3 / JioFi 4 / JioFi 5 / JioFi 6 and other JioFi...

Linux

DNF stands Dandified YUM and this is the default package manager for RHEL 8 / CentOS 8.  This tutorial explains you how to create...

Windows

How to download and install the Mobile Intel 4 Series Express Chipset Graphics Drivers for Windows 10.  Windows 10 is the one of the...

Windows

How to Install and Configure PCSX2 on Windows 10. The Windows 10 is the most recommended operating system for the Games. In stream platform...