Return-Path: 
 <user-return-9759-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id F2EAD102B0
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Mon,  5 Aug 2013 02:46:55 +0000 (UTC)
Received: (qmail 73171 invoked by uid 500); 5 Aug 2013 02:46:48 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 73086 invoked by uid 500); 5 Aug 2013 02:46:46 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Delivered-To: moderator for user@hadoop.apache.org
Received: (qmail 56856 invoked by uid 99); 31 Jul 2013 21:28:53 -0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of rmangler@gmail.com designates
 209.85.219.42 as permitted sender)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=RRdxihuG4EA+nJhNhLCBU+y79m2f/9ItmNUuwJopi1E=;
        b=hXVgEDGdSlhCW5A2IDI3fu/OsC1jsL1uZX1exDevolhzJGj0aAzgkX5Pa/1hD5TJkY
         eu1SFUIntwFEtjdz4Sk9bJs+94fIxY2Ef0l2RW5BrIyM9DO192iksHxPSco85DlCPtr7
         DCZKv8nX/BbX5VXe4JOR26Alc6hcQSqm07QkDP5ysBKwSW2Kkh99l3i4VpNA4eMHisKQ
         VV+8nvS8OdtSJQeO7RzRgDFuUUxZPzwk70TwsSPS/1nisOkVcndn94EnkN9x70Zek051
         kwcOOD5YIP5yQTZXG+G0FBe9GXhV1UwTnQELaU1mnl/UUZkFlAaUPneHwbFy7m2gwua3
         N+og==
MIME-Version: 1.0
X-Received: by 10.50.132.98 with SMTP id ot2mr929517igb.38.1375306107889; Wed,
 31 Jul 2013 14:28:27 -0700 (PDT)
Date: Wed, 31 Jul 2013 16:28:27 -0500
Message-ID: 
 <CANioO8EivtBDT4m+3=Q3hgrZtLKtsb8zgFO=DfzcJyMN+9xtkg@mail.gmail.com>
Subject: YARN with local filesystem
From: Rod Paulk <rmangler@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b2e3d7e04b21404e2d56834
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7b2e3d7e04b21404e2d56834
Content-Type: text/plain; charset=ISO-8859-1

I am having an issue running 2.0.5-alpha (BigTop-0.6.0) YARN-MapReduce on
the local filesystem instead of HDFS.   The appTokens file that the error
states is missing, does exist after the job fails.  I saw other 'similar'
issues noted in YARN-917, YARN-513, YARN-993.   When I switch to HDFS, the
jobs run fine.

In core-site.xml
<property>
  <name>fs.defaultFS</name>
  <value>file:///</value>
</property>

In mapred-site.xml
<property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
</property>

2013-07-29 16:13:06,549 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl:
Start request for container_1375138534137_0003_01_000001 by user rpaulk

2013-07-29 16:13:06,549 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl:
Creating a new application reference for app application_1375138534137_0003

2013-07-29 16:13:06,549 INFO
org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=rpaulk
IP=172.20.130.215       OPERATION=Start Container Request
TARGET=ContainerManageImpl      RESULT=SUCCESS
APPID=application_1375138534137_0003
CONTAINERID=container_1375138534137_0003_01_000001

2013-07-29 16:13:06,551 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1375138534137_0003 transitioned from NEW to INITING

2013-07-29 16:13:06,551 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Adding container_1375138534137_0003_01_000001 to application
application_1375138534137_0003

2013-07-29 16:13:06,554 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1375138534137_0003 transitioned from INITING to
RUNNING

2013-07-29 16:13:06,555 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Container container_1375138534137_0003_01_000001 transitioned from NEW to
LOCALIZING

*2013-07-29 16:13:06,555 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_13751385
*

*34137_0003/appTokens transitioned from INIT to DOWNLOADING*

2013-07-29 16:13:06,556 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_13751385

34137_0003/job.jar transitioned from INIT to DOWNLOADING

2013-07-29 16:13:06,556 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_13751385

34137_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING

2013-07-29 16:13:06,556 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_13751385

34137_0003/job.split transitioned from INIT to DOWNLOADING

2013-07-29 16:13:06,556 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/job.xml
transitioned from INIT to DOWNLOADING

2013-07-29 16:13:06,556 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
Created localizer for container_1375138534137_0003_01_000001

2013-07-29 16:13:06,559 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
Writing credentials to the nmPrivate file
/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1375138534137_0003_01_000001.tokens.
Credentials list:

2013-07-29 16:13:06,560 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Initializing user rpaulk

2013-07-29 16:13:06,564 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying
from
/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1375138534137_0003_01_000001.tokens
to
/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/rpaulk/appcache/application_1375138534137_0003/container_1375138534137_0003_01_000001.tokens

2013-07-29 16:13:06,564 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD set
to
/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/rpaulk/appcache/application_1375138534137_0003
=
file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/rpaulk/appcache/application_1375138534137_0003

*2013-07-29 16:13:06,646 ERROR
org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
as:rpaulk (auth:SIMPLE) cause:java.io.FileNotFoundException: File
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/appTokens
does not exist*

2013-07-29 16:13:06,648 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
DEBUG: FAILED {
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/appTokens,
1375139459000, FILE, null }

RemoteTrace:

java.io.FileNotFoundException: File
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/appTokens
does not exist

        at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:492)

        at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:395)

        at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:176)

        at
org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:51)

        at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.java:284)

        at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.java:282)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1478)

        at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:280)

        at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:51)

        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)

        at java.util.concurrent.FutureTask.run(FutureTask.java:138)

        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)

        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)

        at java.util.concurrent.FutureTask.run(FutureTask.java:138)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

        at java.lang.Thread.run(Thread.java:662)

 at LocalTrace:

        org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl:
File
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/appTokens
does not exist

        at
org.apache.hadoop.yarn.server.nodemanager.api.protocolrecords.impl.pb.LocalResourceStatusPBImpl.convertFromProtoFormat(LocalResourceStatusPBImpl.java:217)

        at
org.apache.hadoop.yarn.server.nodemanager.api.protocolrecords.impl.pb.LocalResourceStatusPBImpl.getException(LocalResourceStatusPBImpl.java:147)

        at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.update(ResourceLocalizationService.java:819)

        at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker.processHeartbeat(ResourceLocalizationService.java:491)

        at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.heartbeat(ResourceLocalizationService.java:218)

        at
org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.service.LocalizationProtocolPBServiceImpl.heartbeat(LocalizationProtocolPBServiceImpl.java:46)

        at
org.apache.hadoop.yarn.proto.LocalizationProtocol$LocalizationProtocolService$2.callBlockingMethod(LocalizationProtocol.java:57)

        at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:454)

        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1014)

        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1741)

        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1737)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1478)

        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1735)

2013-07-29 16:13:06,650 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Container container_1375138534137_0003_01_000001 transitioned from
LOCALIZING to LOCALIZATION_FAILED

*2013-07-29 16:13:06,650 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/appTokens
transitioned from DOWNLOADING to INIT*

2013-07-29 16:13:06,650 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/job.jar
transitioned from DOWNLOADING to INIT

2013-07-29 16:13:06,650 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/job.splitmetainfo
transitioned from DOWNLOADING to INIT

2013-07-29 16:13:06,650 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/job.split
transitioned from DOWNLOADING to INIT

2013-07-29 16:13:06,650 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534137_0003/job.xml
transitioned from DOWNLOADING to INIT

2013-07-29 16:13:06,652 WARN
org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=rpaulk
    OPERATION=Container
Finished - Failed   TARGET=ContainerImpl    RESULT=FAILURE
DESCRIPTION=Container
failed with state: LOCALIZATION_FAILED  APPID=application_1375138534137_0003
CONTAINERID=container_1375138534137_0003_01_000001

2013-07-29 16:13:06,652 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Container container_1375138534137_0003_01_000001 transitioned from
LOCALIZATION_FAILED to DONE

2013-07-29 16:13:06,652 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Removing container_1375138534137_0003_01_000001 from application
application_1375138534137_0003

2013-07-29 16:13:06,652 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl:
Considering container container_1375138534137_0003_01_000001 for
log-aggregation

2013-07-29 16:13:06,652 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Deleting absolute path :
/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/rpaulk/appcache/application_1375138534137_0003/container_1375138534137_0003_01_000001

--047d7b2e3d7e04b21404e2d56834
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:=
#1f497d"><font size=3D"3" face=3D"Calibri">I am having an issue running 2.0=
.5-alpha (BigTop-0.6.0) YARN-MapReduce on the local filesystem instead of H=
DFS.<span style>=A0=A0 The appTokens file that the error states is missing,=
 does exist after the job fails.=A0 I saw other &#39;similar&#39; issues=A0=
noted in=A0YARN-917, YARN-513, YARN-993.=A0=A0 When I switch to HDFS, the j=
obs run fine.=A0 </span></font></span></div>

<div style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:=
#1f497d"><font color=3D"#000000" face=3D"Arial"><span style></span></font><=
/span>=A0</div>
<div style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:=
#1f497d"><font size=3D"3" face=3D"Calibri">In core-site.xml<br></font></spa=
n><span style=3D"COLOR:#1f497d"><font color=3D"#008080"><font color=3D"#008=
080">&lt;</font></font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">prop=
erty</font></font><font color=3D"#008080"><font color=3D"#008080">&gt;<br>
</font></font><font color=3D"#008080"><font color=3D"#008080">=A0 &lt;</fon=
t></font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">name</font></font>=
<font color=3D"#008080"><font color=3D"#008080">&gt;</font></font><font>fs.=
defaultFS</font><font color=3D"#008080"><font color=3D"#008080">&lt;/</font=
></font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">name</font></font><=
font color=3D"#008080"><font color=3D"#008080">&gt;<br>
</font></font><font color=3D"#008080"><font color=3D"#008080">=A0 &lt;</fon=
t></font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">value</font></font=
><font color=3D"#008080"><font color=3D"#008080">&gt;</font></font><font>fi=
le:///</font><font color=3D"#008080"><font color=3D"#008080">&lt;/</font></=
font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">value</font></font><fo=
nt color=3D"#008080"><font color=3D"#008080">&gt;<br>
</font></font><font color=3D"#008080"><font color=3D"#008080">&lt;/</font><=
/font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">property</font></font=
><font color=3D"#008080"><font color=3D"#008080">&gt;</font></font></span><=
/div><span style=3D"COLOR:#1f497d"><font size=3D"3" face=3D"Calibri">
<div style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><br>In mapred-site.xm=
l<br><font color=3D"#008080"><font color=3D"#008080">&lt;</font></font><fon=
t color=3D"#3f7f7f"><font color=3D"#3f7f7f">property</font></font><font col=
or=3D"#008080"><font color=3D"#008080">&gt;<br>
=A0 </font></font><font color=3D"#008080"><font color=3D"#008080">&lt;</fon=
t></font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">name</font></font>=
<font color=3D"#008080"><font color=3D"#008080">&gt;</font></font><font><a =
href=3D"http://mapreduce.framework.name">mapreduce.framework.name</a></font=
><font color=3D"#008080"><font color=3D"#008080">&lt;/</font></font><font c=
olor=3D"#3f7f7f"><font color=3D"#3f7f7f">name</font></font><font color=3D"#=
008080"><font color=3D"#008080">&gt;<br>
</font></font><font color=3D"#008080"><font color=3D"#008080">=A0 &lt;</fon=
t></font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">value</font></font=
><font color=3D"#008080"><font color=3D"#008080">&gt;</font></font><font>ya=
rn</font><font color=3D"#008080"><font color=3D"#008080">&lt;/</font></font=
><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">value</font></font><font c=
olor=3D"#008080"><font color=3D"#008080">&gt;<br>
</font></font><font color=3D"#008080"><font color=3D"#008080">&lt;/</font><=
/font><font color=3D"#3f7f7f"><font color=3D"#3f7f7f">property</font></font=
><font color=3D"#008080"><font color=3D"#008080">&gt;<br></font></font></di=
v></font></span>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,549 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManage=
rImpl: Start request for container_1375138534137_0003_01_000001 by user rpa=
ulk</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,549 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManage=
rImpl: Creating a new application reference for app application_13751385341=
37_0003</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,549 INFO=
 org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=3Drpaulk<spa=
n style>=A0=A0=A0=A0=A0=A0 </span>IP=3D172.20.130.215<span style>=A0=A0=A0=
=A0=A0=A0 </span>OPERATION=3DStart Container Request<span style>=A0=A0=A0=
=A0=A0=A0 </span>TARGET=3DContainerManageImpl<span style>=A0=A0=A0=A0=A0 </=
span>RESULT=3DSUCCESS<span style>=A0=A0=A0 </span>APPID=3Dapplication_13751=
38534137_0003<span style>=A0=A0=A0 </span>CONTAINERID=3Dcontainer_137513853=
4137_0003_01_000001</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,551 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.application.App=
lication: Application application_1375138534137_0003 transitioned from NEW =
to INITING</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,551 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.application.App=
lication: Adding container_1375138534137_0003_01_000001 to application appl=
ication_1375138534137_0003</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,554 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.application.App=
lication: Application application_1375138534137_0003 transitioned from INIT=
ING to RUNNING</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,555 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Conta=
iner: Container container_1375138534137_0003_01_000001 transitioned from NE=
W to LOCALIZING</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><b><span style=3D"COLOR=
:#1f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,555 I=
NFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Lo=
calizedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/r=
paulk/.staging/job_13751385</font></font></span></b></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><b><span style=3D"COLOR=
:#1f497d"><font size=3D"3"><font face=3D"Calibri">34137_0003/appTokens tran=
sitioned from INIT to DOWNLOADING</font></font></span></b></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,556 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_13751385</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">34137_0003/job.jar transitio=
ned from INIT to DOWNLOADING</font></font></span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,556 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_13751385</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">34137_0003/job.splitmetainfo=
 transitioned from INIT to DOWNLOADING</font></font></span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,556 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_13751385</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">34137_0003/job.split transit=
ioned from INIT to DOWNLOADING</font></font></span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,556 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_1375138534137_0003/job.xml transitioned from INIT to DOWNLO=
ADING</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,556 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Resou=
rceLocalizationService: Created localizer for container_1375138534137_0003_=
01_000001</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,559 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Resou=
rceLocalizationService: Writing credentials to the nmPrivate file /var/lib/=
hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1375138534137_0003_=
01_000001.tokens. Credentials list: </font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,560 INFO=
 org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initia=
lizing user rpaulk</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,564 INFO=
 org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copyin=
g from /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_137=
5138534137_0003_01_000001.tokens to /var/lib/hadoop-yarn/cache/yarn/nm-loca=
l-dir/usercache/rpaulk/appcache/application_1375138534137_0003/container_13=
75138534137_0003_01_000001.tokens</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,564 INFO=
 org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD se=
t to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/rpaulk/appcache=
/application_1375138534137_0003 =3D file:/var/lib/hadoop-yarn/cache/yarn/nm=
-local-dir/usercache/rpaulk/appcache/application_1375138534137_0003</font><=
/font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><b><span style=3D"COLOR=
:#1f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,646 E=
RROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionExce=
ption as:rpaulk (auth:SIMPLE) cause:java.io.FileNotFoundException: File fil=
e:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job_1375138534=
137_0003/appTokens does not exist</font></font></span></b></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,648 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Resou=
rceLocalizationService: DEBUG: FAILED { file:/nas/scratch/localfs-1/hadoop-=
yarn/staging/rpaulk/.staging/job_1375138534137_0003/appTokens, 137513945900=
0, FILE, null }</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">RemoteTrace: </font></font><=
/span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">java.io.FileNotFoundExceptio=
n: File file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.staging/job=
_1375138534137_0003/appTokens does not exist</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawL=
ocalFileSystem.java:492)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(Filter=
FileSystem.java:395)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.jav=
a:176)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownlo=
ad.java:51)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.ja=
va:284)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.ja=
va:282)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.security.AccessController.doPrivileged(Native Method)=
</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at javax.security.auth.Subject.doAs(Subject.java:396)</font><=
/font></span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.security.UserGroupInformation.doAs(UserG=
roupInformation.java:1478)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.jav=
a:280)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.jav=
a:51)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.j=
ava:303)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.util.concurrent.FutureTask.run(FutureTask.java:138)</=
font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.util.concurrent.Executors$RunnableAdapter.call(Execut=
ors.java:441)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.j=
ava:303)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.util.concurrent.FutureTask.run(FutureTask.java:138)</=
font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Thr=
eadPoolExecutor.java:886)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadP=
oolExecutor.java:908)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.lang.Thread.run(Thread.java:662)</font></font></span>=
</p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0</span>at Loc=
alTrace: </font></font></span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteException=
PBImpl: File file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpaulk/.stagin=
g/job_1375138534137_0003/appTokens does not exist</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.server.nodemanager.api.protocolreco=
rds.impl.pb.LocalResourceStatusPBImpl.convertFromProtoFormat(LocalResourceS=
tatusPBImpl.java:217)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.server.nodemanager.api.protocolreco=
rds.impl.pb.LocalResourceStatusPBImpl.getException(LocalResourceStatusPBImp=
l.java:147)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.server.nodemanager.containermanager=
.localizer.ResourceLocalizationService$LocalizerRunner.update(ResourceLocal=
izationService.java:819)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.server.nodemanager.containermanager=
.localizer.ResourceLocalizationService$LocalizerTracker.processHeartbeat(Re=
sourceLocalizationService.java:491)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.server.nodemanager.containermanager=
.localizer.ResourceLocalizationService.heartbeat(ResourceLocalizationServic=
e.java:218)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.serv=
ice.LocalizationProtocolPBServiceImpl.heartbeat(LocalizationProtocolPBServi=
ceImpl.java:46)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.yarn.proto.LocalizationProtocol$Localiza=
tionProtocolService$2.callBlockingMethod(LocalizationProtocol.java:57)</fon=
t></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpc=
Invoker.call(ProtobufRpcEngine.java:454)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1014)</font=
></font></span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:174=
1)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:173=
7)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at java.security.AccessController.doPrivileged(Native Method)=
</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at javax.security.auth.Subject.doAs(Subject.java:396)</font><=
/font></span></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.security.UserGroupInformation.doAs(UserG=
roupInformation.java:1478)</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri"><span style>=A0=A0=A0=A0=A0=
=A0=A0 </span>at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1735)=
</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,650 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Conta=
iner: Container container_1375138534137_0003_01_000001 transitioned from LO=
CALIZING to LOCALIZATION_FAILED</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><b><span style=3D"COLOR=
:#1f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,650 I=
NFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Lo=
calizedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/r=
paulk/.staging/job_1375138534137_0003/appTokens transitioned from DOWNLOADI=
NG to INIT</font></font></span></b></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,650 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_1375138534137_0003/job.jar transitioned from DOWNLOADING to=
 INIT</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,650 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_1375138534137_0003/job.splitmetainfo transitioned from DOWN=
LOADING to INIT</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,650 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_1375138534137_0003/job.split transitioned from DOWNLOADING =
to INIT</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,650 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.Local=
izedResource: Resource file:/nas/scratch/localfs-1/hadoop-yarn/staging/rpau=
lk/.staging/job_1375138534137_0003/job.xml transitioned from DOWNLOADING to=
 INIT</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,652 WARN=
 org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=3Drpaulk<spa=
n style>=A0=A0=A0=A0=A0=A0 </span>OPERATION=3DContainer Finished - Failed<s=
pan style>=A0=A0 </span>TARGET=3DContainerImpl<span style>=A0=A0=A0 </span>=
RESULT=3DFAILURE<span style>=A0 </span>DESCRIPTION=3DContainer failed with =
state: LOCALIZATION_FAILED<span style>=A0 </span>APPID=3Dapplication_137513=
8534137_0003<span style>=A0=A0=A0 </span>CONTAINERID=3Dcontainer_1375138534=
137_0003_01_000001</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,652 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Conta=
iner: Container container_1375138534137_0003_01_000001 transitioned from LO=
CALIZATION_FAILED to DONE</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,652 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.application.App=
lication: Removing container_1375138534137_0003_01_000001 from application =
application_1375138534137_0003</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,652 INFO=
 org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.=
AppLogAggregatorImpl: Considering container container_1375138534137_0003_01=
_000001 for log-aggregation</font></font></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"COLOR:#1=
f497d"><font size=3D"3"><font face=3D"Calibri">2013-07-29 16:13:06,652 INFO=
 org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleti=
ng absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/r=
paulk/appcache/application_1375138534137_0003/container_1375138534137_0003_=
01_000001</font></font></span></p>

--047d7b2e3d7e04b21404e2d56834--