Install Cloudera Hadoop with YARN on Ubuntu

Objective:

This tutorial describes how to install and configure a single-node Hadoop cluster on Ubuntu OS. Single Node Hadoop cluster is also called as Hadoop Pseudo-Distributed Mode. The tutorial is very simple and to the point, so that you can install Hadoop in 10 Min. Once the installation is done you can perform Hadoop Distributed File System (HDFS) and Hadoop Map-Reduce operations.

Recommended Platform:

• OS: Linux is supported as a development and production platform. You can use Ubuntu 14.04 or later (you can also use other Linux flavors like: CentOS, Redhat, etc.)
• Hadoop: Cloudera Distribution for Apache hadoop CDH5.x (you can use Apache hadoop 2.x)

Prerequisites:

Install Java 7 (Recommended Oracle Java)

Install Python Software Properties

$sudo apt-get install python-software-properties

Add Repository

$sudo add-apt-repository ppa:webupd8team/java

Update the source list

$sudo apt-get update

Install Java

$sudo apt-get install oracle-java7-installer

Configure SSH

Install Open SSH Server-Client

$sudo apt-get install openssh-server openssh-client

Generate Key Pairs

$ssh-keygen -t rsa -P ""

3.2.3 Configure password-less SSH

$cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys

Check by SSH to localhost

$ssh localhost

Install Hadoop

Download Hadoop

http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.5.0-cdh5.3.2.tar.gz

Untar Tar ball

$tar xzf hadoop-2.5.0-cdh5.3.2.tar.gz

Note: All the required jars, scripts, configuration files, etc. are available in HADOOP_HOME directory (hadoop-2.5.0-cdh5.3.2)

Read Complete Post >>