Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-issues@hadoop.apache.org
Date: Sat, 1 Dec 2012 05:58:00 +0000 (UTC)
From: "Bikas Saha (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <1373389546.48443.1354341480373.JavaMail.jiratomcat@arcas>
In-Reply-To: <1552518506.21954.1353900058198.JavaMail.jiratomcat@arcas>
Subject: [jira] [Commented] (YARN-244) Application Master Retries fail due
 to FileNotFoundException
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/YARN-244?page=3Dcom.atlassian.j=
ira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D135078=
77#comment-13507877 ]=20

Bikas Saha commented on YARN-244:
---------------------------------

Would be good to open a jira for the AM crashing. Why is it crashing?
               =20
> Application Master Retries fail due to FileNotFoundException
> ------------------------------------------------------------
>
>                 Key: YARN-244
>                 URL: https://issues.apache.org/jira/browse/YARN-244
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: applications
>    Affects Versions: 2.0.2-alpha, 2.0.1-alpha
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>            Priority: Blocker
>
> Application attempt1 is deleting the job related files and these are not =
present in the HDFS for following retries.
> {code:xml}
> Application application_1353724754961_0001 failed 4 times due to AM Conta=
iner for appattempt_1353724754961_0001_000004 exited with exitCode: -1000 d=
ue to: RemoteTrace: java.io.FileNotFoundException: File does not exist: hdf=
s://hacluster:8020/tmp/hadoop-yarn/staging/mapred/.staging/job_135372475496=
1_0001/appTokens at org.apache.hadoop.hdfs.DistributedFileSystem.getFileSta=
tus(DistributedFileSystem.java:752) at org.apache.hadoop.yarn.util.FSDownlo=
ad.copy(FSDownload.java:88) at org.apache.hadoop.yarn.util.FSDownload.acces=
s$000(FSDownload.java:49) at org.apache.hadoop.yarn.util.FSDownload$1.run(F=
SDownload.java:157) at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownl=
oad.java:155) at java.security.AccessController.doPrivileged(Native Method)=
 at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop=
.security.UserGroupInformation.doAs(UserGroupInformation.java:1232) at org.=
apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:153) at org.apache.=
hadoop.yarn.util.FSDownload.call(FSDownload.java:49) at java.util.concurren=
t.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.Fut=
ureTask.run(FutureTask.java:138) at java.util.concurrent.Executors$Runnable=
Adapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.in=
nerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTa=
sk.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Thre=
adPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.=
run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) a=
t LocalTrace: org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteException=
PBImpl: File does not exist: hdfs://hacluster:8020/tmp/hadoop-yarn/staging/=
mapred/.staging/job_1353724754961_0001/appTokens at org.apache.hadoop.yarn.=
server.nodemanager.api.protocolrecords.impl.pb.LocalResourceStatusPBImpl.co=
nvertFromProtoFormat(LocalResourceStatusPBImpl.java:217) at org.apache.hado=
op.yarn.server.nodemanager.api.protocolrecords.impl.pb.LocalResourceStatusP=
BImpl.getException(LocalResourceStatusPBImpl.java:147) at org.apache.hadoop=
.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationSer=
vice$LocalizerRunner.update(ResourceLocalizationService.java:822) at org.ap=
ache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLoca=
lizationService$LocalizerTracker.processHeartbeat(ResourceLocalizationServi=
ce.java:492) at org.apache.hadoop.yarn.server.nodemanager.containermanager.=
localizer.ResourceLocalizationService.heartbeat(ResourceLocalizationService=
.java:221) at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.service=
.LocalizationProtocolPBServiceImpl.heartbeat(LocalizationProtocolPBServiceI=
mpl.java:46) at org.apache.hadoop.yarn.proto.LocalizationProtocol$Localizat=
ionProtocolService$2.callBlockingMethod(LocalizationProtocol.java:57) at or=
g.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(Protob=
ufRpcEngine.java:427) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:924=
) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1692) at org.ap=
ache.hadoop.ipc.Server$Handler$1.run(Server.java:1688) at java.security.Acc=
essController.doPrivileged(Native Method) at javax.security.auth.Subject.do=
As(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doA=
s(UserGroupInformation.java:1232) at org.apache.hadoop.ipc.Server$Handler.r=
un(Server.java:1686) .Failing this attempt.. Failing the application.=20
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs
For more information on JIRA, see: http://www.atlassian.com/software/jira