pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jarek Jarcec Cecho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3285) Jobs using HBaseStorage fail to ship dependency jars
Date Fri, 15 Nov 2013 22:33:20 GMT

    [ https://issues.apache.org/jira/browse/PIG-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13824186#comment-13824186
] 

Jarek Jarcec Cecho commented on PIG-3285:
-----------------------------------------

I really do like idea behind this patch, thank you for driving the effort on both sides  [~ndimiduk]!
Do you think that we can leave the older code laying around for couple of Pig releases and
switch between those two conditionally based on the HBase version? I'm concerned a bit about
backward compatibility here as this patch will make pig not working on a HBase releases where
it is currently working.

> Jobs using HBaseStorage fail to ship dependency jars
> ----------------------------------------------------
>
>                 Key: PIG-3285
>                 URL: https://issues.apache.org/jira/browse/PIG-3285
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>             Fix For: 0.13.0
>
>         Attachments: 0001-PIG-3285-Add-HBase-dependency-jars.patch, 0001-PIG-3285-Add-HBase-dependency-jars.patch,
0001-PIG-3285-Add-HBase-dependency-jars.patch, 1.pig, 1.txt, 2.pig
>
>
> Launching a job consuming {{HBaseStorage}} fails out of the box. The user must specify
{{-Dpig.additional.jars}} for HBase and all of its dependencies. Exceptions look something
like this:
> {noformat}
> 2013-04-19 18:58:39,360 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.NoClassDefFoundError:
com/google/protobuf/Message
> 	at org.apache.hadoop.hbase.io.HbaseObjectWritable.<clinit>(HbaseObjectWritable.java:266)
> 	at org.apache.hadoop.hbase.ipc.Invocation.write(Invocation.java:139)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.sendParam(HBaseClient.java:612)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:975)
> 	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:84)
> 	at $Proxy7.getProtocolVersion(Unknown Source)
> 	at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:136)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:208)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message