hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gera Shegalov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6293) uberized job fails with the job classloader enabled
Date Mon, 20 Apr 2015 01:56:00 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502223#comment-14502223
] 

Gera Shegalov commented on MAPREDUCE-6293:
------------------------------------------

Thanks for v2, [~sjlee0]!

Can we just use implicit {{toString}} ? 
{code}
152	      // note the current TCCL
153	      LOG.info("Context classloader of thread " + eventHandler +
154	          ": " + eventHandler.getContextClassLoader());
{code}

Then we would not need to worry whether eventHandler.setContextClassLoader(null) was ever
called.




> uberized job fails with the job classloader enabled
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-6293
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6293
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mr-am
>    Affects Versions: 2.6.0
>            Reporter: Sangjin Lee
>            Assignee: Sangjin Lee
>         Attachments: MAPREDUCE-6293.001.patch, MAPREDUCE-6293.002.patch
>
>
> An uberized job fails if the job classloader is enabled and the job needs to use the
thread context classloader to load a class. Some example error in the log:
> {quote}
> 2015-03-23 23:28:34,675 INFO [main\] org.apache.hadoop.mapreduce.v2.util.MRApps: Creating
job classloader
> ...
> 2015-03-23 23:28:42,096 ERROR [uber-SubtaskRunner\] cascading.provider.ServiceLoader:
unable to find service class: cascading.tuple.hadoop.collect.HadoopTupleMapFactory, with exception:
java.lang.ClassNotFoundException: cascading.tuple.hadoop.collect.HadoopTupleMapFactory
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message