Return-Path: 
 <mapreduce-issues-return-77082-apmail-hadoop-mapreduce-issues-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 977301725A
	for <apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org>;
 Thu,  2 Apr 2015 21:03:13 +0000 (UTC)
Received: (qmail 13077 invoked by uid 500); 2 Apr 2015 21:03:07 -0000
Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org
Received: (qmail 13014 invoked by uid 500); 2 Apr 2015 21:03:07 -0000
Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:mapreduce-issues-help@hadoop.apache.org>
List-Unsubscribe: <mailto:mapreduce-issues-unsubscribe@hadoop.apache.org>
List-Post: <mailto:mapreduce-issues@hadoop.apache.org>
List-Id: <mapreduce-issues.hadoop.apache.org>
Reply-To: mapreduce-issues@hadoop.apache.org
Delivered-To: mailing list mapreduce-issues@hadoop.apache.org
Received: (qmail 13001 invoked by uid 99); 2 Apr 2015 21:03:07 -0000
Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Apr 2015 21:03:07 +0000
Date: Thu, 2 Apr 2015 21:03:06 +0000 (UTC)
From: "Hadoop QA (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: <JIRA.12702148.1395150580000.111231.1428008586955@Atlassian.JIRA>
In-Reply-To: <JIRA.12702148.1395150580000@Atlassian.JIRA>
References: <JIRA.12702148.1395150580000@Atlassian.JIRA>
 <JIRA.12702148.1395150580597@arcas>
Subject: [jira] [Commented] (MAPREDUCE-5799) add default value of
 MR_AM_ADMIN_USER_ENV
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


    [ https://issues.apache.org/jira/browse/MAPREDUCE-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393404#comment-14393404 ] 

Hadoop QA commented on MAPREDUCE-5799:
--------------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12635312/MAPREDUCE-5799.diff
  against trunk revision 6a6a59d.

    {color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5369//console

This message is automatically generated.

> add default value of MR_AM_ADMIN_USER_ENV
> -----------------------------------------
>
>                 Key: MAPREDUCE-5799
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5799
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 2.3.0
>            Reporter: Liyin Liang
>            Assignee: Liyin Liang
>         Attachments: MAPREDUCE-5799.diff
>
>
> Submit a 1 map + 1 reduce sleep job with the following config:
> {code}
>   <property>
>       <name>mapreduce.map.output.compress</name>
>       <value>true</value>
>   </property>
>   <property>
>       <name>mapreduce.map.output.compress.codec</name>
>       <value>org.apache.hadoop.io.compress.SnappyCodec</value>
>   </property>
> <property>
>   <name>mapreduce.job.ubertask.enable</name>
>   <value>true</value>
> </property>
> {code}
> And the LinuxContainerExecutor is enable on NodeManager.
> This job will fail with the following error:
> {code}
> 2014-03-18 21:28:20,153 FATAL [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: Error running local (uberized) 'child' : java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
>         at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native Method)
>         at org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63)
>         at org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:132)
>         at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:148)
>         at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:163)
>         at org.apache.hadoop.mapred.IFile$Writer.<init>(IFile.java:115)
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1583)
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1462)
>         at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:700)
>         at org.apache.hadoop.mapred.MapTask.closeQuietly(MapTask.java:1990)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:774)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
>         at org.apache.hadoop.mapred.LocalContainerLauncher$SubtaskRunner.runSubtask(LocalContainerLauncher.java:317)
>         at org.apache.hadoop.mapred.LocalContainerLauncher$SubtaskRunner.run(LocalContainerLauncher.java:232)
>         at java.lang.Thread.run(Thread.java:662)
> {code}
> When create a ContainerLaunchContext for task in TaskAttemptImpl.createCommonContainerLaunchContext(), the DEFAULT_MAPRED_ADMIN_USER_ENV which is "LD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native" is added to the environment. Where when create a ContainerLaunchContext for mrappmaster in YARNRunner.createApplicationSubmissionContext(), there is no default environment. So the ubermode job fails to find native lib.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)