hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-9165) Improvements to addDependencyJars
Date Thu, 14 Nov 2013 23:37:24 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823113#comment-13823113
] 

Lars Hofhansl edited comment on HBASE-9165 at 11/14/13 11:37 PM:
-----------------------------------------------------------------

So with mapred we are removing:
{code}
-      org.apache.zookeeper.ZooKeeper.class,
-      com.google.common.base.Function.class,
-      com.google.protobuf.Message.class,
{code}
And adding:
{code}
+      org.apache.zookeeper.ZooKeeper.class,
+      com.google.protobuf.Message.class,
+      com.google.common.collect.ImmutableSet.class,
+      org.apache.hadoop.hbase.util.Bytes.class
{code}

Is that correct?



was (Author: lhofhansl):
So with mapred we are removing:
-      org.apache.zookeeper.ZooKeeper.class,
-      com.google.common.base.Function.class,
-      com.google.protobuf.Message.class,

And adding:
+      org.apache.zookeeper.ZooKeeper.class,
+      com.google.protobuf.Message.class,
+      com.google.common.collect.ImmutableSet.class,
+      org.apache.hadoop.hbase.util.Bytes.class

Is that correct?


> Improvements to addDependencyJars
> ---------------------------------
>
>                 Key: HBASE-9165
>                 URL: https://issues.apache.org/jira/browse/HBASE-9165
>             Project: HBase
>          Issue Type: Sub-task
>          Components: mapreduce
>    Affects Versions: 0.95.2
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>             Fix For: 0.98.0, 0.96.1, 0.94.14
>
>         Attachments: 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch,
0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch, 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch,
HBASE-9165-0.94.00.patch
>
>
> The way we support adding HBase dependencies to a MapReduce job in {{TableMapReduceUtils#addDependencyJars(job)}}
is a bit monolithic. Advanced users need a way to add HBase and its dependencies to their
job without us snooping around for ouput formats and the like (see PIG-3285). We can also
benefit from a little more code reuse between our {{mapred}} and {{mapreduce}} namespaces.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message