hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shanyu zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
Date Sun, 24 Jan 2016 04:37:39 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114196#comment-15114196
] 

shanyu zhao commented on MAPREDUCE-6454:
----------------------------------------

The patch in this JIRA caused regression. Previously the MR container inherit HADOOP_CLASSPATH
from system environment, now it completely replaced it. I think we need to add this line to
the end of setClasspath() in MRApps.java:
{code}
    MRApps.addToEnvironment(
        environment,
        hadoopClasspathEnvVar,
        System.getenv(hadoopClasspathEnvVar),
        conf);
{code}

> MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6454
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>             Fix For: 2.7.2, 2.6.2
>
>         Attachments: MAPREDUCE-6454-v2.1.patch, MAPREDUCE-6454-v2.patch, MAPREDUCE-6454-v3.1.patch,
MAPREDUCE-6454-v3.patch, MAPREDUCE-6454.patch
>
>
> We already set lib jars on distributed-cache to CLASSPATH. However, in some corner cases
(like: MR local mode, Hive Map side local join, etc.), we need these jars on HADOOP_CLASSPATH
so hadoop scripts can take it in launching runjar process.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message