Installing Hive

Hi Guys Today we will learn how to install Hive. It is very easy and needs only few steps.
before you start installing hive, you should have already installed hadoop. If not please check out hadoop installation post.

Steps to install Hive.

1. Download Hive from Hive 0.11.0. If you want to install other version of Hive, check its comparability with hadoop version that you have already installed. In my case i am using hadoop 1.0.3

2. Go to downloads folder, right click and extract hive-0.11.0.tar.gz.

3. Copy the extracted jar into /home/hduser/hive.

4. Edit /etc/bash.bashrc and export HADOOP_HOME if not set.

       on Lubuntu
              sudo leafpad /etc/bash.bashrc
       on ubuntu
              sudo gedit /etc/bash.bashrc

        for people new to linux, leafpad and gedit are two editors to edit text files similar to notepad in windows.
5. Insert following statement in file.
        
     export HADOOP_HOME=/home/hduser/hadoop
     export HIVE_HOME= /home/hduser/hive
     export PATH=$PATH:$HADOOP_HOME/bin
     export PATH=$PATH:$HIVE_HOME/bin

6. Save the file and close it. Now close the terminal and reopen it.

7. Type hive and then enter. if your installation is right , you will log into hive shell. 

Now you can run hive queries on this shell. This installation considers embedded meta-store of hive(on derby database). In coming posts we will learn how to install hive in distributed mode. Stay tuned for videos on this and share your feedback. :)

Comments

  1. Unknown3 February 2014 at 20:43

    Hey! Harjeet,

    The hive-0.10.0.tar.gz. Link which is mentioned is broken, Can we use the Higher or Later version of HIVE?

    ReplyDelete
    Replies
    1. Unknown3 February 2014 at 21:12

      Thanks Vinay for correction... I thinks old link is removed. I have changed link.
      Yes you can use newer version. just check for compatibility with hadoop version that you are using

      Delete
  2. shekhar reddy19 February 2014 at 01:31

    This comment has been removed by the author.

    ReplyDelete
  3. shekhar reddy19 February 2014 at 01:33

    Hello Harjeet,
    Please add below command to switch off safemode for Ubuntu users if they are getting problem while executing queries in hive prompt.

    bin/hadoop dfsadmin -safemode leave

    regards,
    Shekhar Redd

    ReplyDelete
  4. Unknown1 December 2014 at 03:49

    This comment has been removed by the author.

    ReplyDelete
  5. Unknown1 December 2014 at 04:40

    Harjeet,
    Thanks for sharing the steps.

    In the export HIVE_HOME path, space between equal to sign (=) and actual hive path causes error. Please change to

    export HIVE_HOME=/home/hduser/hive

    ReplyDelete

Post a Comment

Popular posts from this blog

Hive UDF Example

UDF(User Defined Function) is a Very important functionality provided by Hive. It is very simple to create a UDF for Hive. In this tutorial we will learn creating UDF and how to use it with hive. There are two possible ways to create UDF. 1. using org.apache.hadoop.hive.ql.exec.UDF 2. using  org.apache.hadoop.hive.ql.udf.generic.GenericUDF        If input and output to your custom function is basic type eg. Text, FloatWritable, DoubleWritable,IntWritable etc the use  org.apache.hadoop.hive.ql.exec.UDF.        If yor input and output can be Map, set, list type of data structure the use  using  org.apache.hadoop.hive.ql.udf.generic.GenericUDF. We will discuss the first type of UDF here. I will write one more post to discuss the second approach. First of all lets assume I want to create a hive function called toUpper which will convert a string to uppercase. Follow the following steps to achieve it. 1. Download and install eclipse from  here 2. Hive should be installed, if
Read more

Custom UDF in Apache Spark

Image
Apache Spark has become very widely used framework to build Big data application. Spark SQL has made adhoc analysis on structured data very easy, So it is very popular among users who deal with huge amount of structured data. However many times you will realise that some functionality is not available in Spark SQL. For example in Spark 1.3.1 , when you are using sqlContext basic functions like variance , standard deviation and percentile are not available(You can access these using HiveContext). In a similar situation, you may like to do some string operation on an input column but functionality may not be available in sqlContext. In such situations , we can use spark udf to add new constructs in sqlContext. I have found them very handy, specially while processing string type columns. In this post we will discuss how to create UDFs in Spark and  how to use them. Use Case : Let us keep this example very simple. We will create a udf which will take a string as input and it will conve
Read more

Hadoop series : Pseudo Distributed Mode Hadoop Instalation

In this tutorial, we will learn required steps of setting up Hadoop on single node also called pseudo distributed mode. How ever as part of this series we will also setup hadoop on multiple machines. We will also learn Map Reduce, hive , Pig etc.So stay tuned, Here it comes .... :) We need Following this to start with. Ubuntu: I always prefer ubuntu as my linux flavour. However if you are using a very low end machine with very small ram, you can install Lubuntu also. Lubuntu is very light weight and any low end machine should work. If you have a windows machine. you can install hadoop using cygwin or VirtualBox or Vmware player.  Here we go... Steps for installation of Hadoop. If you are using Windows follow steps from 1 to 4 1. Download  and install Virtual box from https://www.virtualbox.org/wiki/Downloads   2. Download ubuntu from  http://www.ubuntu.com/download/desktop . If you have low  configuration machine then you can use Lubuntu. download Lubuntu from 
Read more