Pig 0.13.0 Installation on Hadoop 2.6.0 on Ubuntu 14.04

Following Installation steps will execute successfully only when you have installed Hadoop with the help of this link. open terminal window sudo su hduser cd sudo wget http://apache-mirror.rbc.ru/pub/apache/pig/pig-0.13.0/pig-0.13.0.tar.gz sudo cp pig-0.13.0.tar.gz /usr/local/ cd /usr/local sudo tar -xvf pig-0.13.0.tar.gz sudo mv pig-0.13.0 pig sudo rm pig-0.13.0.tar.gz sudo chown hduser:hadoop -R pig Add PIG variables in bashrc … Continue reading Pig 0.13.0 Installation on Hadoop 2.6.0 on Ubuntu 14.04

NetBeans IDE Installation on Ubuntu 14.04

Download NetBeans IDE through web browser from https://netbeans.org/downloads/ open new terminal window cd Downloads sudo chmod +x netbeans* ./netbeans* Above command will open a GUI which will guide you to install netbeans step by step.  

Hive 1.1.1 Installation on single node hadoop 2.6.0 on ubuntu 14.04

sudo su hduser cd sudo wget http://mirror.tcpdiag.net/apache/hive/hive-1.1.1/apache-hive-1.1.1-bin.tar.gz sudo cp apache-hive-1.1.1-bin.tar.gz /usr/local/ cd /usr/local/ sudo tar -xvf apache-hive-1.1.1-bin.tar.gz sudo mv apache-hive-1.1.1-bin hive sudo chown hduser:hadoop -R hive cd sudo nano ~/.bashrc #HIVE VARIABLES START export HIVE_HOME=/usr/local/hive export PATH=$PATH:$HIVE_HOME/bin #HIVE VARIABLES END ctrl+x Y <enter> source ~/.bashrc hive if you get some error related to found class … Continue reading Hive 1.1.1 Installation on single node hadoop 2.6.0 on ubuntu 14.04

Single Node Hadoop Installation on Ubuntu 14.04

Following are the steps which should be followed in order to install Hadoop 2.6.0 on ubuntu 14.04 open terminal window -------------------------------------------------------------------------------------------------------------------------------- step 1 : install java run following commands command 1 : sudo apt-get update command 2 : sudo apt-get install default-jdk this will install JAVA in your system command 1 : javac -version command … Continue reading Single Node Hadoop Installation on Ubuntu 14.04

vi editor basics

following are the basic things which you should know regarding vi editor 1. we use vi editor to edit/create files using terminal window 2. syntax : vi <filename> explanation : if <filename> does not exist, it will create that file and if it does exist, then it will open that file for editing 3. there … Continue reading vi editor basics

Hadoop Commands Example

cat => hadoop fs -cat /hdfs_home/input/abc.txt chmod => hadoop fs -chmod 777 /hdfs_home/input/abc.txt chown => hadoop fs -chown hduser:hadoop /hdfs_home/input/abc.txt copyFromLocal => hadoop fs -copyFromLocal /home/anoop/abc.txt /hdfs_home/input/ copyToLocal => hadoop fs -copyToLocal /hdfs_home/input/abc.txt /home/anoop/ cp => hadoop fs -cp /hdfs_home/input/abc.txt /hdfs_home/output/ du => hadoop fs -du /hdfs_home/input/ get => hadoop fs - get /hdfs_home/input/abc.txt /home/anoop/ … Continue reading Hadoop Commands Example