hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Dimiduk (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8158) Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job"
Date Tue, 02 Apr 2013 17:15:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13620011#comment-13620011
] 

Nick Dimiduk commented on HBASE-8158:
-------------------------------------

Further development when into this patch than in the initial version on trunk. Notably, the
precise order of class look-up for jar discovery is eventually different on this ticket than
what went into trunk, hence the parity patch.

Trouble is, JarFinder isn't actually provided by released hadoop yet, on any version. It might
be on the classpath in a test jar, but not in a production deployment. IMHO, the reflection
code should not have been added as it was, because it was a work-around for a broken test
environment.

We now have a legitimate use-case for this same code-path, hence it gaining some new attention.

I'll take a look at the hadoop-compat modules on 0.95/trunk and see if I can make sense of
a variation, update the parity patch accordingly. The 0.94 patch still applies. We'll still
need to ship the backported JarFinder for 1.x hadoops and, unless HADOOP-9426 squeezes in
soon, for early releases of the 2.x line as well.
                
> Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another
MR job"
> --------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-8158
>                 URL: https://issues.apache.org/jira/browse/HBASE-8158
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.94.7
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>         Attachments: 8158-port-jarfinder-0.94.patch, 8158-port-jarfinder-0.94.patch,
8158-port-jarfinder-0.94.patch, 8158-port-jarfinder-0.94.patch, 8158-port-jarfinder-0.94.patch,
8158-trunk-parity.patch
>
>
> Assess the stability of the JarFinder util class from Hadoop-2, as a candidate for backporting
to 0.94.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message