hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2379) Hive/HBase integration could be improved
Date Sun, 21 Apr 2013 16:21:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13637588#comment-13637588
] 

Ashutosh Chauhan commented on HIVE-2379:
----------------------------------------

Navis, current patch uses  TableMapReduceUtil.addDependencyJars(job, Object...). Recommendation
is to use  TableMapReduceUtil.addDependencyJars(job). Difference between two apis is that
second one automatically puts in hbase dependencies, so that we don't have to. That way in
future if HBase adds new dependency, we will still be safe. So, we need to do:
{code}
 TableMapReduceUtil.addDependencyJars(job)
 TableMapReduceUtil.addDependencyJars(job, HBaseStorageHandler.class)
{code}
thats it.
                
> Hive/HBase integration could be improved
> ----------------------------------------
>
>                 Key: HIVE-2379
>                 URL: https://issues.apache.org/jira/browse/HIVE-2379
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI, Clients, HBase Handler
>    Affects Versions: 0.7.1, 0.8.0, 0.9.0
>            Reporter: Roman Shaposhnik
>            Assignee: Navis
>            Priority: Critical
>         Attachments: HIVE-2379.D7347.1.patch, HIVE-2379.D7347.2.patch
>
>
> For now any Hive/HBase queries would require the following jars to be explicitly added
via hive's add jar command:
> add jar /usr/lib/hive/lib/hbase-0.90.1-cdh3u0.jar;
> add jar /usr/lib/hive/lib/hive-hbase-handler-0.7.0-cdh3u0.jar;
> add jar /usr/lib/hive/lib/zookeeper-3.3.1.jar;
> add jar /usr/lib/hive/lib/guava-r06.jar;
> the longer term solution, perhaps, should be to have the code at submit time call hbase's

> TableMapREduceUtil.addDependencyJar(job, HBaseStorageHandler.class) to ship it in distributedcache.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message