hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2934) Improve handling of container's stderr
Date Tue, 09 Dec 2014 15:08:12 GMT

    [ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239518#comment-14239518
] 

Naganarasimha G R commented on YARN-2934:
-----------------------------------------

Hi [~jira.shegalov],
     AFAIK some time launching container fails and the exit information is present in the
NM logs 
{quote}
2014-12-06 14:43:42,583 | WARN  | ContainersLauncher #32 | Exception from container-launch
with container ID: container_1417695705818_0094_01_33554435 and exit code: 134 | org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:310)
ExitCodeException exitCode=134: /bin/bash: line 1: 77143 Aborted                 /opt/huawei/Bigdata/jdk1.7.0_60//bin/java
-Xms2048m -Xmx2048m -server -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled
-XX:+UseCMSCompactAtFullCollection -XX:CMSFullGCsBeforeCompaction=0 -XX:+CMSClassUnloadingEnabled
-XX:LargePageSizeInBytes=128M -XX:+UseFastAccessorMethods -XX:+UseCMSInitiatingOccupancyOnly
-XX:CMSInitiatingOccupancyFraction=20 -XX:SoftRefLRUPolicyMSPerMB=0 -agentlib:jdwp=transport=dt_socket,address=33233,server=y,suspend=n
com.huawei.data.integration.dataflow.runtime.yarn.app.StreamNodeContainer -cc-host linux81
-cc-port 32335 -cluster-net-ip-address linux81 -data-ip-address linux81 -node-id linux81 -result-ip-address
linux81 > /srv/BigData/yarn/nm/containerlogs/application_1417695705818_0094/container_1417695705818_0094_01_33554435/stdout
2> /srv/BigData/yarn/nm/containerlogs/application_1417695705818_0094/container_1417695705818_0094_01_33554435/stderr

	at org.apache.hadoop.util.Shell.runCommand(Shell.java:537)
	at org.apache.hadoop.util.Shell.run(Shell.java:454)
{quote}
And these kind of errors/exceptions needs to be present in container's stderr also . Is this
the goal of this jira ?


> Improve handling of container's stderr 
> ---------------------------------------
>
>                 Key: YARN-2934
>                 URL: https://issues.apache.org/jira/browse/YARN-2934
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Gera Shegalov
>            Assignee: Naganarasimha G R
>
> Most YARN applications redirect stderr to some file. That's why when container launch
fails with {{ExitCodeException}} the message is empty.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message