hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vijay shinde <vijaysanj...@gmail.com>
Subject Re: HBASE and HIVE Integration
Date Wed, 25 Jul 2012 13:28:49 GMT
Hi Bejoy,

Thanks for quick reply. Here are some additional details

Cloudera Version - CDH3U4

*hive-site.xml*
**
*<property>
<name>hive.aux.jars.path</name>
<value>file:///usr/lib/hive/lib/hive-hbase-handler-0.7.1-cdh3u2.jar,file:///usr/lib/hive/lib/hbase-0.90.4-cdh3u2.jar,file:///usr/lib/hive/lib/zookeeper-3.3.1.jar,file:///usr/lib/hive/lib/hive-contrib-0.7.1-cdh3u2.jar</value>
</property>
*
*Execution Log*


1. *start zookeeper*

[root@localhost zookeeper]# ./bin/zkServer.sh start



2. *start hbase*



3. *start hive. I am setting hive jars in hive-site.xml*



./bin/hive -hiveconf hbase.master=127.0.1.1:60010


4. *Create new HBase table which is to be managed by Hive*
**

CREATE TABLE hive_hbasetable_k(key int, value string)

STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'

WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")

TBLPROPERTIES ("hbase.table.name" = "hivehbasek");



5. *Create a logical table pokes in Hive*

CREATE TABLE pokes (foo INT, bar STRING);

6. *HIve error while inserting the data from Hive Poke table to HBASE table*

*hive> INSERT OVERWRITE TABLE hive_hbasetable_k SELECT * FROM pokes WHERE
foo=98;*
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201207250246_0005, Tracking URL =
http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207250246_0005
Kill Command = /usr/lib/hadoop-0.20/bin/hadoop job  -Dmapred.job.tracker=
0.0.0.0:8021 -kill job_201207250246_0005
2012-07-25 04:26:00,198 Stage-0 map = 0%,  reduce = 0%
2012-07-25 04:27:00,767 Stage-0 map = 0%,  reduce = 0%
2012-07-25 04:27:08,844 Stage-0 map = 100%,  reduce = 100%
Ended Job = job_201207250246_0005 with errors

*FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
*
Let me know if you need any additonal information.

Thanks,
Vijay

On Wed, Jul 25, 2012 at 5:30 AM, Bejoy KS <bejoy_ks@yahoo.com> wrote:

> **
> Hi Vijay
>
> Can you share more details like
>
> The CDH Version/Hive version you are using
>
> Steps you followed for hive hbase integration with the values you set
>
> The DDL used for hive hbase integration
>
> The actual error from failed map reduce task
>
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
> ------------------------------
> *From: *vijay shinde <vijaysanjyot@gmail.com>
> *Date: *Wed, 25 Jul 2012 04:45:41 -0400
> *To: *<user@hive.apache.org>
> *ReplyTo: *user@hive.apache.org
> *Subject: *HBASE and HIVE Integration
>
> I am facing issue while executing HIVE queries on HBASE-HIVE integration.
> I followed the wiki hbase-hive integration
> https://cwiki.apache.org/Hive/hbaseintegration.html
>
> I have already passed all the required jars for auxpath in hive-site.xml
> file.
> I am using Cloudera CDH demo VM.. Any help would be highly appreciated
>
> hive> INSERT OVERWRITE TABLE hive_hbasetable_k SELECT * FROM pokes WHERE
> foo=98;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Starting Job = job_201207250246_0005, Tracking URL =
> http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207250246_0005
> Kill Command = /usr/lib/hadoop-0.20/bin/hadoop job  -Dmapred.job.tracker=
> 0.0.0.0:8021 -kill job_201207250246_0005
> 2012-07-25 04:26:00,198 Stage-0 map = 0%,  reduce = 0%
> 2012-07-25 04:27:00,767 Stage-0 map = 0%,  reduce = 0%
> 2012-07-25 04:27:08,844 Stage-0 map = 100%,  reduce = 100%
> Ended Job = job_201207250246_0005 with errors
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedTask
> hive>
>
>

Mime
View raw message