hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9165) Improvements to addDependencyJars
Date Sun, 17 Nov 2013 04:09:21 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13824727#comment-13824727
] 

Lars Hofhansl commented on HBASE-9165:
--------------------------------------

The reason is probably this from the logs:
{code}
2013-11-16 17:57:00,896 DEBUG [pool-1-thread-1] mapreduce.TableMapReduceUtil(665): For class
org.apache.hadoop.hbase.util.Bytes, using jar /x1/jenkins/jenkins-slave/workspace/HBase-0.94/trunk/target/test-dir/hadoop-1223249546787952422.jar
{code}
This does not happen on my local box.

> Improvements to addDependencyJars
> ---------------------------------
>
>                 Key: HBASE-9165
>                 URL: https://issues.apache.org/jira/browse/HBASE-9165
>             Project: HBase
>          Issue Type: Sub-task
>          Components: mapreduce
>    Affects Versions: 0.95.2
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>             Fix For: 0.98.0, 0.96.1, 0.94.14
>
>         Attachments: 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch,
0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch, 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch,
HBASE-9165-0.94.00.patch, HBASE-9165-0.94.01.patch, HBASE-9165-0.96.00.patch, HBASE-9165.02.patch
>
>
> The way we support adding HBase dependencies to a MapReduce job in {{TableMapReduceUtils#addDependencyJars(job)}}
is a bit monolithic. Advanced users need a way to add HBase and its dependencies to their
job without us snooping around for ouput formats and the like (see PIG-3285). We can also
benefit from a little more code reuse between our {{mapred}} and {{mapreduce}} namespaces.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message