hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bruno Dumon (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-3076) Allow to disable automatic shipping of dependency jars for mapreduce jobs
Date Tue, 19 Oct 2010 16:22:27 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Bruno Dumon updated HBASE-3076:

    Attachment: tablemapreduceutil-optional-adddependencies-patch-v2.txt

Updated patch for current trunk.

> Allow to disable automatic shipping of dependency jars for mapreduce jobs
> -------------------------------------------------------------------------
>                 Key: HBASE-3076
>                 URL: https://issues.apache.org/jira/browse/HBASE-3076
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>            Reporter: Bruno Dumon
>            Assignee: Bruno Dumon
>            Priority: Minor
>         Attachments: tablemapreduceutil-optional-adddependencies-patch-v2.txt, tablemapreduceutil-optional-adddependencies-patch.txt
> Since HBASE-3001, TableMapReduceUtil.initTableMap/ReduceJob will automatically upload
the HBase jars needed to execute a map reduce job.
> In my case I am building a job jar using Maven's assembly plugin, this way all the necessary
dependencies are in the job jar. So in such case the default behavior of HBase causes some
needless upload work. It also uploads hadoop-core itself which is not necessary.
> Therefore I propose to add a variant of the initTableMap/ReduceJob methods with an extra
boolean argument to disable the automatic adding of dependency jars.
> I will attach a patch with the proposed change.
> Note that everything works as is, this is just an optimization.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message