Thursday, December 18, 2014

Install Hadoop in 10 Steps | pseudo distributed mode |Linux Platform

Step 1: Run the following command to install hadoop from yum
repository in a pseudo distributed mode

sudo yum install hadoop‐0.20‐conf‐pseudo

Step 2: Verify if the packages are installed properly
rpm ‐ql hadoop‐0.20‐conf‐pseudo


Step 3: Format the namenode
sudo ‐u hdfs hdfs namenode ‐format

Step 4: Stop existing services
$ for service in /etc/init.d/hadoop*
> do
> sudo $service stop
> done

Step 5: Start HDFS
$ for service in /etc/init.d/hadoop‐hdfs‐*
> do
> sudo $service start
> done

Step 6: Verify if HDFS has started properly (In the browser)
http://localhost:50070

Step 7: Create the /tmp directory
$ sudo ‐u hdfs hadoop fs ‐mkdir /tmp
$ sudo ‐u hdfs hadoop fs ‐chmod ‐R 1777 /tmp

Step 8: Create mapreduce specific directories
sudo -u hdfs hadoop fs -mkdir /var/lib/hadoop-hdfs/cache/mapred/mapred/staging
sudo -u hdfs hadoop fs -chmod -R 1777 /var/lib/hadoop-hdfs/cache/mapred/mapred/staging
sudo -u hdfs hadoop fs -chown -R mapred /var/lib/hadoop-hdfs/cache/mapred

Step 9: Start MapReduce
$ for service in /etc/init.d/hadoop‐0.20‐
mapreduce‐*
> do
> sudo $service start
> done

Step 10: Verify if MapReduce has started properly (In Browser)
http://localhost:50030

No comments:

Post a Comment