hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6356) Dependency injection in hbase storage handler is broken
Date Thu, 13 Feb 2014 03:48:19 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13899984#comment-13899984
] 

Navis commented on HIVE-6356:
-----------------------------

bq. Is the job failing due to missing dependencies
Yes, it fails with ClassNotFoundException. 
{code}
org.apache.hadoop.hbase.mapred.TableMapReduceUtil.addDependencyJars(jobConf)
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(jobConf, HBaseStorageHandler.class)
{code}
This adds zookeeper, netty, guava, hadoop, hive-exec, hive-hbase-handler to tmpJars, missing
hbase related classes. 

bq. I think copying really is that bad
Agree. Just wanted quick, easy fix.

bq. What do you mean "second method"?
In my comment above, "Anyway, we can resolve this with patch1 (copy needed class list from
TableMapReduceUtil) or make new Job instance and copy values from it to original JobConf".
You can see it in patch3.


> Dependency injection in hbase storage handler is broken
> -------------------------------------------------------
>
>                 Key: HIVE-6356
>                 URL: https://issues.apache.org/jira/browse/HIVE-6356
>             Project: Hive
>          Issue Type: Bug
>          Components: HBase Handler
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>             Fix For: 0.13.0
>
>         Attachments: HIVE-6356.1.patch.txt, HIVE-6356.2.patch.txt, HIVE-6356.3.patch.txt,
HIVE-6356.addendum.00.patch
>
>
> Dependent jars for hbase is not added to tmpjars, which is caused by the change of method
signature(TableMapReduceUtil.addDependencyJars).



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message