hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
Date Thu, 20 Aug 2015 22:26:46 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14705894#comment-14705894

Vinod Kumar Vavilapalli commented on MAPREDUCE-6454:

bq. What happens if the user has HADOOP_CLASSPATH set in hadoop-env.sh?
 - If the user has this on the submission node, that is not getting inherited - this is similar
to what we do fro CLASSPATH.
 - If the admin sets it in the daemons, and also configures yarn to white-list those envs,
we are inheriting them into the task. Again similar to CLASSPATH.

> MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
> ----------------------------------------------------------------------------
>                 Key: MAPREDUCE-6454
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>         Attachments: MAPREDUCE-6454-v2.1.patch, MAPREDUCE-6454-v2.patch, MAPREDUCE-6454-v3.1.patch,
MAPREDUCE-6454-v3.patch, MAPREDUCE-6454.patch
> We already set lib jars on distributed-cache to CLASSPATH. However, in some corner cases
(like: MR local mode, Hive Map side local join, etc.), we need these jars on HADOOP_CLASSPATH
so hadoop scripts can take it in launching runjar process.

This message was sent by Atlassian JIRA

View raw message