hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Azuryy Yu <azury...@gmail.com>
Subject Map tasks succeed with container was killed with 143.
Date Tue, 01 Apr 2014 06:38:32 GMT
Hi,

I built from the trunk, 3 NMs and 2 RMs with HA enable, when I run MR job,
it succeed, but I found the same exception in every map task log:

I've configured yarn.nodemanager.log-dirs and yarn.nodemanager.local-dirs
with different HDD, and log aggregation enabled.

2014-04-01 14:24:54,971 INFO [main] org.apache.hadoop.mapred.Task:
Task:attempt_1396333353086_0001_m_000000_0 is done. And is in the process
of committing
2014-04-01 14:24:55,032 WARN [main] org.apache.hadoop.mapred.Task: Could
not find output size
java.io.FileNotFoundException: File does not exist:
/data/hadoop/data7/yarn/data/usercache/root/appcache/application_1396333353086_0001/output/attempt_1396333353086_0001_m_000000_0/file.out
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1029)
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1021)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1021)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1124)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1102)
at org.apache.hadoop.mapred.Task.done(Task.java:1048)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:344)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1597)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
2014-04-01 14:24:55,038 INFO [main] org.apache.hadoop.mapred.Task: Task
'attempt_1396333353086_0001_m_000000_0' done.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message