hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
Date Fri, 21 Aug 2015 01:35:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706076#comment-14706076
] 

Allen Wittenauer edited comment on MAPREDUCE-6454 at 8/21/15 1:35 AM:
----------------------------------------------------------------------

Just so it's on record so when someone hits this problem:  this is fragile and subject to
breakage, regardless of the version of hadoop in play.  It all depends upon how users have
HADOOP_CLASSPATH configured in hadoop-env.sh and yarn-env.sh.  


was (Author: aw):
Just so it's on record so when someone hits this problem:  this is fragile and subject to
breakage.  It all depends upon how users have HADOOP_CLASSPATH configured in hadoop-env.sh
and yarn-env.sh.  

> MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6454
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>             Fix For: 2.7.2, 2.6.2
>
>         Attachments: MAPREDUCE-6454-v2.1.patch, MAPREDUCE-6454-v2.patch, MAPREDUCE-6454-v3.1.patch,
MAPREDUCE-6454-v3.patch, MAPREDUCE-6454.patch
>
>
> We already set lib jars on distributed-cache to CLASSPATH. However, in some corner cases
(like: MR local mode, Hive Map side local join, etc.), we need these jars on HADOOP_CLASSPATH
so hadoop scripts can take it in launching runjar process.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message