Pig 0.13.0 Installation on Hadoop 2.6.0 on Ubuntu 14.04

Following Installation steps will execute successfully only when you have installed Hadoop with the help of this link. open terminal window sudo su hduser cd sudo wget http://apache-mirror.rbc.ru/pub/apache/pig/pig-0.13.0/pig-0.13.0.tar.gz sudo cp pig-0.13.0.tar.gz /usr/local/ cd /usr/local sudo tar -xvf pig-0.13.0.tar.gz sudo mv pig-0.13.0 pig sudo rm pig-0.13.0.tar.gz sudo chown hduser:hadoop -R pig Add PIG variables in bashrcContinue reading “Pig 0.13.0 Installation on Hadoop 2.6.0 on Ubuntu 14.04”

NetBeans IDE Installation on Ubuntu 14.04

Download NetBeans IDE through web browser from https://netbeans.org/downloads/ open new terminal window cd Downloads sudo chmod +x netbeans* ./netbeans* Above command will open a GUI which will guide you to install netbeans step by step.  

Hive 1.1.1 Installation on single node hadoop 2.6.0 on ubuntu 14.04

sudo su hduser cd sudo wget http://mirror.tcpdiag.net/apache/hive/hive-1.1.1/apache-hive-1.1.1-bin.tar.gz sudo cp apache-hive-1.1.1-bin.tar.gz /usr/local/ cd /usr/local/ sudo tar -xvf apache-hive-1.1.1-bin.tar.gz sudo mv apache-hive-1.1.1-bin hive sudo chown hduser:hadoop -R hive cd sudo nano ~/.bashrc #HIVE VARIABLES START export HIVE_HOME=/usr/local/hive export PATH=$PATH:$HIVE_HOME/bin #HIVE VARIABLES END ctrl+x Y <enter> source ~/.bashrc hive if you get some error related to found classContinue reading “Hive 1.1.1 Installation on single node hadoop 2.6.0 on ubuntu 14.04”

Single Node Hadoop Installation on Ubuntu 14.04

Following are the steps which should be followed in order to install Hadoop 2.6.0 on ubuntu 14.04 open terminal window ——————————————————————————————————————————– step 1 : install java run following commands command 1 : sudo apt-get update command 2 : sudo apt-get install default-jdk this will install JAVA in your system command 1 : javac -version commandContinue reading “Single Node Hadoop Installation on Ubuntu 14.04”

vi editor basics

following are the basic things which you should know regarding vi editor 1. we use vi editor to edit/create files using terminal window 2. syntax : vi <filename> explanation : if <filename> does not exist, it will create that file and if it does exist, then it will open that file for editing 3. thereContinue reading “vi editor basics”

Hadoop Commands Example

cat => hadoop fs -cat /hdfs_home/input/abc.txt chmod => hadoop fs -chmod 777 /hdfs_home/input/abc.txt chown => hadoop fs -chown hduser:hadoop /hdfs_home/input/abc.txt copyFromLocal => hadoop fs -copyFromLocal /home/anoop/abc.txt /hdfs_home/input/ copyToLocal => hadoop fs -copyToLocal /hdfs_home/input/abc.txt /home/anoop/ cp => hadoop fs -cp /hdfs_home/input/abc.txt /hdfs_home/output/ du => hadoop fs -du /hdfs_home/input/ get => hadoop fs – get /hdfs_home/input/abc.txt /home/anoop/Continue reading “Hadoop Commands Example”

Install Apache Solr on windows

download the latest version of the zip file for windows from http://www.eu.apache.org/dist/lucene/solr/ unzip it and go to bin folder in this directory run following command to start running solr in localhost solr.cmd start if above command gives you error like findstr is not recognized as an internal or external command then go to My ComputerContinue reading “Install Apache Solr on windows”

Set Hive in Local / Auto Mode

Setting Hive in “AUTO/LOCAL MODE” comes very handy when you are dealing with small amount of data. How this works? Well, suppose you are running some complex hive query, then you know that it will trigger MapReduce job in background and will give you the output. This approach works well if the data size isContinue reading “Set Hive in Local / Auto Mode”