hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-3561) Non-AM Containers continue to run even after AM is stopped
Date Thu, 30 Apr 2015 09:17:07 GMT

     [ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran updated YARN-3561:
---------------------------------
    Fix Version/s:     (was: 2.6.1)

> Non-AM Containers continue to run even after AM is stopped
> ----------------------------------------------------------
>
>                 Key: YARN-3561
>                 URL: https://issues.apache.org/jira/browse/YARN-3561
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager, yarn
>    Affects Versions: 2.6.0
>         Environment: debian 7
>            Reporter: Gour Saha
>            Priority: Critical
>
> Non-AM containers continue to run even after application is stopped. This occurred while deploying Storm 0.9.3 using Slider (0.60.0 and 0.70.1) in a Hadoop 2.6 deployment. 
> Following are the NM logs from 2 different nodes:
> *host-07* - where Slider AM was running
> *host-03* - where Storm NIMBUS container was running.
> *Note:* The logs are partial, starting with the time when the relevant Slider AM and NIMBUS containers were allocated, till the time when the Slider AM was stopped. Also, the large number of "Memory usage" log lines were removed keeping only a few starts and ends of every segment.
> *NM log from host-07 where Slider AM container was running:*
> {noformat}
> 2015-04-29 00:39:24,614 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(356)) - Stopping resource-monitoring for container_1428575950531_0020_02_000001
> 2015-04-29 00:41:10,310 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:10,322 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1428575950531_0021_01_000001 by user yarn
> 2015-04-29 00:41:10,322 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1428575950531_0021
> 2015-04-29 00:41:10,323 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1428575950531_0021 transitioned from NEW to INITING
> 2015-04-29 00:41:10,325 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=yarn	IP=10.84.105.162	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1428575950531_0021	CONTAINERID=container_1428575950531_0021_01_000001
> 2015-04-29 00:41:10,328 WARN  logaggregation.LogAggregationService (LogAggregationService.java:verifyAndCreateRemoteLogDir(195)) - Remote Root Log Dir [/app-logs] already exist, but with incorrect permissions. Expected: [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple users.
> 2015-04-29 00:41:10,328 WARN  logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:<init>(182)) - rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished.
> 2015-04-29 00:41:10,351 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1428575950531_0021_01_000001 to application application_1428575950531_0021
> 2015-04-29 00:41:10,352 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1428575950531_0021 transitioned from INITING to RUNNING
> 2015-04-29 00:41:10,356 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000001 transitioned from NEW to LOCALIZING
> 2015-04-29 00:41:10,357 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1428575950531_0021
> 2015-04-29 00:41:10,357 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/htrace-core-3.0.4.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,357 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jettison-1.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-util-1.0.0-M20.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j-server.properties transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpcore-4.2.5.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,358 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-core-3.0.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-log4j12-1.6.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-env.sh transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-shuffle-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,359 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xercesImpl-2.9.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-hdfs-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-1.7.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/stax-api-1.0.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,360 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-registry-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xmlenc-0.52.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-asl-1.9.13.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,361 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-jvm-3.0.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/paranamer-2.3.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider-core-0.70.1-incubating.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/log4j-1.2.17.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,362 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-client.xml transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-databind-2.2.2.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-servlet-3.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xml-apis-1.3.04.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,363 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j.properties transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-server.xml transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-impl-2.2.3-1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-web-proxy-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,364 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-core-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-client-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-mapper-asl-1.9.13.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/asm-3.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,365 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-sslengine-6.1.26.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/zookeeper-3.4.6.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-common-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsp-api-2.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-auth-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-math3-3.1.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-core-1.9.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-api-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/avro-1.7.4.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-client-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr311-api-1.1.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-2.2.2.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,368 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-framework-2.4.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/netty-3.7.0.Final.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-logging-1.1.3.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-lang-2.6.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,369 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-recipes-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-annotations-2.2.2.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr305-1.3.9.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-api-1.7.5.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,370 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/aopalliance-1.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-digester-1.8.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-json-3.0.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-compress-1.4.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,371 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-jobclient-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-net-3.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-common-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-6.1.26.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,372 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jcommander-1.30.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpclient-4.2.5.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-common-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xz-1.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,373 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-kerberos-codec-2.0.0-M15.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-core-1.8.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-xc-1.9.13.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-healthchecks-3.0.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-io-2.4.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-common-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guava-11.0.2.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-collections-3.2.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,375 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-client-1.9.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/servlet-api-2.5.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/protobuf-java-2.5.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/snappy-java-1.0.4.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,376 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jline-0.9.94.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-i18n-2.0.0-M15.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-api-2.2.7.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/leveldbjni-all-1.8.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,377 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/gson-2.2.2.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-app-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-jaxrs-1.9.13.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,378 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-annotations-2.6.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-json-1.9.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-httpclient-3.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-util-6.1.26.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,379 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-asn1-api-1.0.0-M20.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-server-1.9.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-cli-1.2.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-servlets-3.0.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,380 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-configuration-1.6.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-codec-1.6.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/javax.inject-1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-guice-1.9.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,381 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-client-2.4.1.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,382 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-3.0.jar transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:10,382 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1428575950531_0021_01_000001
> 2015-04-29 00:41:10,384 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000001.tokens. Credentials list: 
> 2015-04-29 00:41:10,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user yarn
> 2015-04-29 00:41:10,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000001.tokens to /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001.tokens
> 2015-04-29 00:41:10,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 = file:/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> 2015-04-29 00:41:10,591 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/htrace-core-3.0.4.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/10/htrace-core-3.0.4.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,620 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jettison-1.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/11/jettison-1.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,652 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-util-1.0.0-M20.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/12/api-util-1.0.0-M20.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,679 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j-server.properties(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/13/log4j-server.properties) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpcore-4.2.5.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/14/httpcore-4.2.5.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,733 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-core-3.0.1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/15/metrics-core-3.0.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,760 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-log4j12-1.6.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/16/slf4j-log4j12-1.6.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,786 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-env.sh(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/17/slider-env.sh) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,813 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-shuffle-2.6.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/18/hadoop-mapreduce-client-shuffle-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,846 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xercesImpl-2.9.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/19/xercesImpl-2.9.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,920 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-hdfs-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/20/hadoop-hdfs-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,952 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-1.7.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/21/commons-beanutils-1.7.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:10,979 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/stax-api-1.0.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/22/stax-api-1.0.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,135 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/23/slider-agent.tar.gz) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,164 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-registry-2.6.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/24/hadoop-yarn-registry-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,192 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xmlenc-0.52.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/25/xmlenc-0.52.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,224 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-asl-1.9.13.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/26/jackson-core-asl-1.9.13.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,250 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-jvm-3.0.1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/27/metrics-jvm-3.0.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,276 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/paranamer-2.3.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/28/paranamer-2.3.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,320 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider-core-0.70.1-incubating.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/29/slider-core-0.70.1-incubating.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,355 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/log4j-1.2.17.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/30/log4j-1.2.17.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,381 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-client.xml(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/31/slider-client.xml) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,414 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-databind-2.2.2.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/32/jackson-databind-2.2.2.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,441 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-servlet-3.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/33/guice-servlet-3.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,468 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xml-apis-1.3.04.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/34/xml-apis-1.3.04.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,494 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/log4j.properties(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/35/log4j.properties) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,519 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/confdir/slider-server.xml(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/36/slider-server.xml) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,558 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-impl-2.2.3-1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/37/jaxb-impl-2.2.3-1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,585 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-web-proxy-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/38/hadoop-yarn-server-web-proxy-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,620 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-core-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/39/hadoop-mapreduce-client-core-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,648 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-client-2.6.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/40/hadoop-yarn-client-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,685 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-mapper-asl-1.9.13.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/41/jackson-mapper-asl-1.9.13.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,712 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/asm-3.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/42/asm-3.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,740 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-sslengine-6.1.26.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/43/jetty-sslengine-6.1.26.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,779 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/zookeeper-3.4.6.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/44/zookeeper-3.4.6.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,811 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-common-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/45/hadoop-mapreduce-client-common-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,839 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsp-api-2.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/46/jsp-api-2.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,873 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-auth-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/47/hadoop-auth-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,909 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-math3-3.1.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/48/commons-math3-3.1.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,943 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-core-1.9.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/49/jersey-core-1.9.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:11,982 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-api-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/50/hadoop-yarn-api-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,015 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/avro-1.7.4.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/51/avro-1.7.4.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,042 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-client-2.6.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/52/hadoop-client-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,069 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr311-api-1.1.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/53/jsr311-api-1.1.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,097 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-core-2.2.2.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/54/jackson-core-2.2.2.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,127 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-framework-2.4.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/55/curator-framework-2.4.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,172 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/netty-3.7.0.Final.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/56/netty-3.7.0.Final.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,218 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-logging-1.1.3.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/57/commons-logging-1.1.3.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,247 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-lang-2.6.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/58/commons-lang-2.6.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,276 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-recipes-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/59/curator-recipes-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,304 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-annotations-2.2.2.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/60/jackson-annotations-2.2.2.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,332 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jsr305-1.3.9.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/61/jsr305-1.3.9.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,359 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slf4j-api-1.7.5.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/62/slf4j-api-1.7.5.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,386 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/aopalliance-1.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/63/aopalliance-1.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,415 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-digester-1.8.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/64/commons-digester-1.8.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,442 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-json-3.0.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/65/metrics-json-3.0.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,473 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-compress-1.4.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/66/commons-compress-1.4.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,506 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-jobclient-2.6.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/67/hadoop-mapreduce-client-jobclient-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,536 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-net-3.1.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/68/commons-net-3.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,565 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-server-common-2.6.0.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/69/hadoop-yarn-server-common-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,601 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-6.1.26.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/70/jetty-6.1.26.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jcommander-1.30.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/71/jcommander-1.30.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,659 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/httpclient-4.2.5.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/72/httpclient-4.2.5.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,696 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-yarn-common-2.6.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/73/hadoop-yarn-common-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,727 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/xz-1.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/74/xz-1.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,765 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-kerberos-codec-2.0.0-M15.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/75/apacheds-kerberos-codec-2.0.0-M15.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,794 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-beanutils-core-1.8.0.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/76/commons-beanutils-core-1.8.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,822 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-xc-1.9.13.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/77/jackson-xc-1.9.13.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,850 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-healthchecks-3.0.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/78/metrics-healthchecks-3.0.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,879 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-io-2.4.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/79/commons-io-2.4.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,927 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-common-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/80/hadoop-common-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:12,964 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guava-11.0.2.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/81/guava-11.0.2.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,001 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-collections-3.2.1.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/82/commons-collections-3.2.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,028 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-client-1.9.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/83/jersey-client-1.9.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,057 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/servlet-api-2.5.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/84/servlet-api-2.5.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,093 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/protobuf-java-2.5.0.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/85/protobuf-java-2.5.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,133 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/snappy-java-1.0.4.1.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/86/snappy-java-1.0.4.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,166 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jline-0.9.94.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/87/jline-0.9.94.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,194 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/apacheds-i18n-2.0.0-M15.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/88/apacheds-i18n-2.0.0-M15.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,223 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jaxb-api-2.2.7.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/89/jaxb-api-2.2.7.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,265 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/leveldbjni-all-1.8.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/90/leveldbjni-all-1.8.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,296 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/gson-2.2.2.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/91/gson-2.2.2.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,333 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-mapreduce-client-app-2.6.0.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/92/hadoop-mapreduce-client-app-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,369 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/slider.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/93/slider.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,397 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jackson-jaxrs-1.9.13.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/94/jackson-jaxrs-1.9.13.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,427 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/hadoop-annotations-2.6.0.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/95/hadoop-annotations-2.6.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,457 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-json-1.9.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/96/jersey-json-1.9.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,487 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-httpclient-3.1.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/97/commons-httpclient-3.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,516 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jetty-util-6.1.26.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/98/jetty-util-6.1.26.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,544 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/api-asn1-api-1.0.0-M20.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/99/api-asn1-api-1.0.0-M20.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,576 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-server-1.9.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/100/jersey-server-1.9.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,606 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-cli-1.2.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/101/commons-cli-1.2.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,634 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/metrics-servlets-3.0.1.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/102/metrics-servlets-3.0.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,663 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-configuration-1.6.jar(->/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/103/commons-configuration-1.6.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,692 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/commons-codec-1.6.jar(->/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/104/commons-codec-1.6.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,721 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/javax.inject-1.jar(->/grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/105/javax.inject-1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/jersey-guice-1.9.jar(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/106/jersey-guice-1.9.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,784 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/curator-client-2.4.1.jar(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/107/curator-client-2.4.1.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,816 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/am/lib/guice-3.0.jar(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/108/guice-3.0.jar) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:13,816 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000001 transitioned from LOCALIZING to LOCALIZED
> 2015-04-29 00:41:13,862 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000001 transitioned from LOCALIZED to RUNNING
> 2015-04-29 00:41:13,870 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001/default_container_executor.sh]
> 2015-04-29 00:41:15,618 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for container_1428575950531_0021_01_000001
> 2015-04-29 00:41:15,664 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 68.0 MB of 3.5 GB physical memory used; 739.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:18,681 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 172.5 MB of 3.5 GB physical memory used; 774.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:21,704 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 190.4 MB of 3.5 GB physical memory used; 799.8 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:23,617 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,627 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1428575950531_0021_01_000005 by user yarn
> 2015-04-29 00:41:23,629 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1428575950531_0021_01_000005 to application application_1428575950531_0021
> 2015-04-29 00:41:23,629 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=yarn	IP=10.84.104.129	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1428575950531_0021	CONTAINERID=container_1428575950531_0021_01_000005
> 2015-04-29 00:41:23,629 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000005 transitioned from NEW to LOCALIZING
> 2015-04-29 00:41:23,630 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1428575950531_0021
> 2015-04-29 00:41:23,630 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:23,631 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1428575950531_0021_01_000005
> 2015-04-29 00:41:23,633 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /grid/4/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000005.tokens. Credentials list: 
> 2015-04-29 00:41:23,755 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user yarn
> 2015-04-29 00:41:23,761 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /grid/4/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000005.tokens to /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000005.tokens
> 2015-04-29 00:41:23,761 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 = file:/grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> 2015-04-29 00:41:23,777 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,782 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1008)) - Getting container-status for container_1428575950531_0021_01_000005
> 2015-04-29 00:41:23,782 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1022)) - Returning ContainerStatus: [ContainerId: container_1428575950531_0021_01_000005, State: RUNNING, Diagnostics: , ExitStatus: -1000, ]
> 2015-04-29 00:41:24,251 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip(->/grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/109/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:24,251 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000005 transitioned from LOCALIZING to LOCALIZED
> 2015-04-29 00:41:24,299 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000005 transitioned from LOCALIZED to RUNNING
> 2015-04-29 00:41:24,307 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000005/default_container_executor.sh]
> 2015-04-29 00:41:24,704 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for container_1428575950531_0021_01_000005
> 2015-04-29 00:41:24,747 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 210.6 MB of 3.5 GB physical memory used; 823.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:24,795 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for container-id container_1428575950531_0021_01_000005: 14.3 MB of 3.5 GB physical memory used; 279.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:27,837 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 211.4 MB of 3.5 GB physical memory used; 824.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:27,884 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for container-id container_1428575950531_0021_01_000005: 15.0 MB of 3.5 GB physical memory used; 280.0 MB of 7.3 GB virtual memory used
> .
> .
> .
> 2015-04-29 00:55:55,558 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 222.8 MB of 3.5 GB physical memory used; 830.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:55,605 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:58,646 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 222.8 MB of 3.5 GB physical memory used; 830.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:58,693 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:00,463 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:56:00,467 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1428575950531_0021_01_000005
> 2015-04-29 00:56:00,468 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=yarn	IP=10.84.104.129	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1428575950531_0021	CONTAINERID=container_1428575950531_0021_01_000005
> 2015-04-29 00:56:00,468 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000005 transitioned from RUNNING to KILLING
> 2015-04-29 00:56:00,469 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1428575950531_0021_01_000005
> 2015-04-29 00:56:01,741 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41169 for container-id container_1428575950531_0021_01_000001: 1.4 MB of 3.5 GB physical memory used; 10.9 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:01,763 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(346)) - Container container_1428575950531_0021_01_000001 succeeded 
> 2015-04-29 00:56:01,763 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
> 2015-04-29 00:56:01,764 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,782 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:01,816 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /grid/1/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,816 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,818 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,819 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /grid/4/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,819 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,820 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(457)) - Deleting absolute path : /grid/6/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,820 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=yarn	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1428575950531_0021	CONTAINERID=container_1428575950531_0021_01_000001
> 2015-04-29 00:56:01,821 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
> 2015-04-29 00:56:01,821 INFO  application.Application (ApplicationImpl.java:transition(347)) - Removing container_1428575950531_0021_01_000001 from application application_1428575950531_0021
> 2015-04-29 00:56:01,822 INFO  logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(488)) - Considering container container_1428575950531_0021_01_000001 for log-aggregation
> 2015-04-29 00:56:01,822 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1428575950531_0021
> 2015-04-29 00:56:02,490 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:56:02,496 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1428575950531_0021_01_000001
> 2015-04-29 00:56:02,497 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=yarn	IP=10.84.105.162	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1428575950531_0021	CONTAINERID=container_1428575950531_0021_01_000001
> 2015-04-29 00:56:02,499 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1428575950531_0021 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT
> 2015-04-29 00:56:04,782 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(356)) - Stopping resource-monitoring for container_1428575950531_0021_01_000001
> 2015-04-29 00:56:04,824 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 41585 for container-id container_1428575950531_0021_01_000005: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> {noformat}
> *NM log from host-03 where NIMBUS container was running:*
> {noformat}
> 2015-04-29 00:41:23,619 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,630 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(803)) - Start request for container_1428575950531_0021_01_000002 by user yarn
> 2015-04-29 00:41:23,631 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(843)) - Creating a new application reference for app application_1428575950531_0021
> 2015-04-29 00:41:23,631 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1428575950531_0021 transitioned from NEW to INITING
> 2015-04-29 00:41:23,632 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=yarn	IP=10.84.104.129	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1428575950531_0021	CONTAINERID=container_1428575950531_0021_01_000002
> 2015-04-29 00:41:23,635 WARN  logaggregation.LogAggregationService (LogAggregationService.java:verifyAndCreateRemoteLogDir(195)) - Remote Root Log Dir [/app-logs] already exist, but with incorrect permissions. Expected: [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple users.
> 2015-04-29 00:41:23,636 WARN  logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:<init>(182)) - rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished.
> 2015-04-29 00:41:23,646 INFO  application.Application (ApplicationImpl.java:transition(304)) - Adding container_1428575950531_0021_01_000002 to application application_1428575950531_0021
> 2015-04-29 00:41:23,647 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1428575950531_0021 transitioned from INITING to RUNNING
> 2015-04-29 00:41:23,647 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000002 transitioned from NEW to LOCALIZING
> 2015-04-29 00:41:23,648 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1428575950531_0021
> 2015-04-29 00:41:23,648 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:23,648 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip transitioned from INIT to DOWNLOADING
> 2015-04-29 00:41:23,648 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1428575950531_0021_01_000002
> 2015-04-29 00:41:23,651 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1148)) - Writing credentials to the nmPrivate file /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000002.tokens. Credentials list: 
> 2015-04-29 00:41:23,766 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(606)) - Initializing user yarn
> 2015-04-29 00:41:23,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(116)) - Copying from /grid/2/hadoop/yarn/local/nmPrivate/container_1428575950531_0021_01_000002.tokens to /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000002.tokens
> 2015-04-29 00:41:23,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(123)) - Localizer CWD set to /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021 = file:/grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021
> 2015-04-29 00:41:23,807 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:41:23,812 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1008)) - Getting container-status for container_1428575950531_0021_01_000002
> 2015-04-29 00:41:23,812 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1022)) - Returning ContainerStatus: [ContainerId: container_1428575950531_0021_01_000002, State: RUNNING, Diagnostics: , ExitStatus: -1000, ]
> 2015-04-29 00:41:23,991 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/cluster/storm1/tmp/application_1428575950531_0021/agent/slider-agent.tar.gz(->/grid/2/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/10/slider-agent.tar.gz) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:24,344 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://zsexp/user/yarn/.slider/package/STORM/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip(->/grid/3/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/filecache/11/slider-storm-app-package-0.9.3.2.2.0.0-2041.zip) transitioned from DOWNLOADING to LOCALIZED
> 2015-04-29 00:41:24,344 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000002 transitioned from LOCALIZING to LOCALIZED
> 2015-04-29 00:41:24,388 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000002 transitioned from LOCALIZED to RUNNING
> 2015-04-29 00:41:24,396 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(267)) - launchContainer: [bash, /grid/5/hadoop/yarn/local/usercache/yarn/appcache/application_1428575950531_0021/container_1428575950531_0021_01_000002/default_container_executor.sh]
> 2015-04-29 00:41:26,947 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(346)) - Starting resource-monitoring for container_1428575950531_0021_01_000002
> 2015-04-29 00:41:26,996 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB physical memory used; 280.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:30,038 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB physical memory used; 280.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:33,087 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.0 MB of 3.5 GB physical memory used; 280.0 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:36,129 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 28.2 MB of 3.5 GB physical memory used; 325.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:39,179 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 86.0 MB of 3.5 GB physical memory used; 63.3 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:42,197 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 100.1 MB of 3.5 GB physical memory used; 31.8 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:45,243 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 167.1 MB of 3.5 GB physical memory used; 31.8 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:48,287 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 256.8 MB of 3.5 GB physical memory used; 1.8 GB of 7.3 GB virtual memory used
> 2015-04-29 00:41:51,336 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.3 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:41:54,379 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.3 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> .
> .
> .
> 2015-04-29 00:55:51,675 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:54,718 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:55:57,760 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:00,482 INFO  ipc.Server (Server.java:saslProcess(1306)) - Auth successful for appattempt_1428575950531_0021_000001 (auth:SIMPLE)
> 2015-04-29 00:56:00,486 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(953)) - Stopping container with container Id: container_1428575950531_0021_01_000002
> 2015-04-29 00:56:00,487 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=yarn	IP=10.84.104.129	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1428575950531_0021	CONTAINERID=container_1428575950531_0021_01_000002
> 2015-04-29 00:56:00,487 INFO  container.Container (ContainerImpl.java:handle(999)) - Container container_1428575950531_0021_01_000002 transitioned from RUNNING to KILLING
> 2015-04-29 00:56:00,489 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(370)) - Cleaning up container container_1428575950531_0021_01_000002
> 2015-04-29 00:56:00,802 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.4 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:02,494 INFO  application.Application (ApplicationImpl.java:handle(464)) - Application application_1428575950531_0021 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT
> 2015-04-29 00:56:03,849 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:06,892 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:09,940 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:12,983 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:16,032 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:19,075 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.5 MB of 3.5 GB physical memory used; 280.3 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:22,122 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:25,164 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:28,211 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:31,253 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:34,302 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:37,344 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:40,392 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:43,434 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:46,482 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:49,523 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:52,570 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:55,613 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:56:58,661 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:01,704 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:04,752 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:07,794 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:10,843 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:13,886 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 280.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:16,935 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 296.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:19,977 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 296.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:23,025 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.6 MB of 3.5 GB physical memory used; 296.5 MB of 7.3 GB virtual memory used
> 2015-04-29 00:57:26,067 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(408)) - Memory usage of ProcessTree 21259 for container-id container_1428575950531_0021_01_000002: 15.7 MB of 3.5 GB physical memory used; 296.5 MB of 7.3 GB virtual memory used
> {noformat}
> *YARN properties of the cluster:*
> {code}
> {
>     "description": "Complete slider application settings", 
>     "updated": 0, 
>     "entries": {
>         "dfs.datanode.data.dir": "/grid/1/dfs/data,/grid/2/dfs/data,/grid/3/dfs/data,/grid/4/dfs/data,/grid/5/dfs/data,/grid/6/dfs/data", 
>         "dfs.namenode.checkpoint.txns": "1000000", 
>         "s3.replication": "3", 
>         "mapreduce.output.fileoutputformat.compress.type": "BLOCK", 
>         "mapreduce.jobtracker.jobhistory.lru.cache.size": "5", 
>         "dfs.datanode.failed.volumes.tolerated": "0", 
>         "hadoop.http.filter.initializers": "org.apache.hadoop.yarn.server.webproxy.amfilter.AmFilterInitializer", 
>         "mapreduce.cluster.temp.dir": "/tmp/hadoop-yarn-${hue.suffix}/mapred/temp", 
>         "mapreduce.reduce.shuffle.memory.limit.percent": "0.25", 
>         "yarn.nodemanager.keytab": "/etc/krb5.keytab", 
>         "dfs.namenode.checkpoint.max-retries": "3", 
>         "nfs.mountd.port": "4242", 
>         "hadoop.registry.zk.retry.times": "5", 
>         "yarn.resourcemanager.zk-acl": "world:anyone:rwcda", 
>         "mapreduce.reduce.skip.maxgroups": "0", 
>         "dfs.https.server.keystore.resource": "ssl-server.xml", 
>         "yarn.app.mapreduce.task.container.log.backups": "0", 
>         "dfs.domain.socket.path": "/var/lib/hadoop-hdfs/dn_socket", 
>         "hadoop.http.authentication.kerberos.keytab": "/home/yarn/hadoop.keytab", 
>         "yarn.timeline-service.generic-application-history.store-class": "org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore", 
>         "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage": "90", 
>         "mapreduce.cluster.administrators": " hadoop", 
>         "dfs.client.block.write.replace-datanode-on-failure.best-effort": "false", 
>         "mapreduce.jobhistory.done-dir": "/mr-history/done", 
>         "yarn.nodemanager.localizer.client.thread-count": "5", 
>         "ha.failover-controller.new-active.rpc-timeout.ms": "60000", 
>         "mapreduce.framework.name": "yarn", 
>         "ha.health-monitor.check-interval.ms": "1000", 
>         "io.file.buffer.size": "131072", 
>         "mapreduce.shuffle.max.connections": "0", 
>         "dfs.namenode.resource.check.interval": "5000", 
>         "dfs.namenode.path.based.cache.block.map.allocation.percent": "0.25", 
>         "dfs.namenode.checkpoint.period": "21600", 
>         "mapreduce.task.tmp.dir": "./tmp", 
>         "ipc.client.kill.max": "10", 
>         "yarn.nodemanager.log-aggregation.debug-enabled": "false", 
>         "dfs.client.mmap.cache.timeout.ms": "3600000", 
>         "yarn.resourcemanager.scheduler.class": "org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler", 
>         "mapreduce.jobtracker.taskcache.levels": "2", 
>         "s3.stream-buffer-size": "4096", 
>         "dfs.namenode.secondary.http-address": "host2:50090", 
>         "yarn.client.nodemanager-connect.max-wait-ms": "900000", 
>         "dfs.namenode.decommission.interval": "30", 
>         "dfs.namenode.http-address": "host1:50070", 
>         "dfs.encrypt.data.transfer": "false", 
>         "mapreduce.task.files.preserve.failedtasks": "false", 
>         "yarn.resourcemanager.bind-host": "0.0.0.0", 
>         "yarn.resourcemanager.ha.enabled": "false", 
>         "dfs.datanode.address": "0.0.0.0:50010", 
>         "dfs.namenode.avoid.write.stale.datanode": "true", 
>         "hadoop.http.authentication.token.validity": "36000", 
>         "yarn.resourcemanager.nodes.exclude-path": "/etc/hadoop/conf/yarn.exclude", 
>         "hadoop.security.group.mapping.ldap.search.filter.group": "(objectClass=group)", 
>         "dfs.client.failover.max.attempts": "15", 
>         "yarn.resourcemanager.scheduler.monitor.policies": "org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy", 
>         "hadoop.registry.zk.connection.timeout.ms": "15000", 
>         "hadoop.security.crypto.cipher.suite": "AES/CTR/NoPadding", 
>         "yarn.timeline-service.http-authentication.simple.anonymous.allowed": "true", 
>         "mapreduce.task.profile.params": "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s", 
>         "yarn.resourcemanager.fs.state-store.retry-policy-spec": "2000, 500", 
>         "yarn.admin.acl": "*", 
>         "yarn.nodemanager.local-cache.max-files-per-directory": "8192", 
>         "yarn.client.failover-retries-on-socket-timeouts": "0", 
>         "dfs.namenode.retrycache.expirytime.millis": "600000", 
>         "yarn.resourcemanager.nodemanagers.heartbeat-interval-ms": "1000", 
>         "dfs.client.failover.connection.retries.on.timeouts": "0", 
>         "yarn.client.failover-proxy-provider": "org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider", 
>         "mapreduce.map.sort.spill.percent": "0.7", 
>         "file.stream-buffer-size": "4096", 
>         "dfs.webhdfs.enabled": "true", 
>         "ipc.client.connection.maxidletime": "0", 
>         "mapreduce.task.combine.progress.records": "10000", 
>         "mapreduce.jobtracker.persist.jobstatus.hours": "1", 
>         "dfs.image.transfer.chunksize": "65536", 
>         "yarn.nodemanager.address": "0.0.0.0:45454", 
>         "dfs.datanode.ipc.address": "0.0.0.0:8010", 
>         "yarn.resourcemanager.ha.automatic-failover.embedded": "true", 
>         "mapreduce.jobhistory.recovery.store.fs.uri": "/tmp/hadoop-yarn-${hue.suffix}/mapred/history/recoverystore", 
>         "dfs.namenode.http-address.$cluster_name.nn1": "host1:50070", 
>         "yarn.resourcemanager.zk-state-store.parent-path": "/rmstore", 
>         "dfs.namenode.http-address.$cluster_name.nn2": "host2:50070", 
>         "yarn.app.mapreduce.am.job.task.listener.thread-count": "30", 
>         "nfs.dump.dir": "/tmp/.hdfs-nfs", 
>         "dfs.namenode.list.cache.pools.num.responses": "100", 
>         "dfs.client.read.shortcircuit": "true", 
>         "dfs.namenode.shared.edits.dir": "qjournal://host2:8485;host3:8485;host1:8485/$cluster_name", 
>         "dfs.namenode.safemode.extension": "30000", 
>         "ha.zookeeper.parent-znode": "/hadoop-ha", 
>         "yarn.nodemanager.container-executor.class": "org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor", 
>         "slider.config.loaded": "true", 
>         "io.skip.checksum.errors": "false", 
>         "dfs.namenode.path.based.cache.refresh.interval.ms": "30000", 
>         "dfs.encrypt.data.transfer.cipher.key.bitlength": "128", 
>         "yarn.resourcemanager.scheduler.client.thread-count": "50", 
>         "yarn.nodemanager.recovery.dir": "/var/log/hadoop-yarn/nodemanager/recovery-state", 
>         "mapreduce.job.emit-timeline-data": "false", 
>         "hadoop.http.authentication.kerberos.principal": "HTTP/_HOST@LOCALHOST", 
>         "mapreduce.reduce.log.level": "INFO", 
>         "yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern": "^[_.A-Za-z0-9][-@_.A-Za-z0-9]{0,255}?[$]?$", 
>         "fs.s3.maxRetries": "4", 
>         "yarn.nodemanager.log-aggregation.num-log-files-per-app": "30", 
>         "mapreduce.admin.reduce.child.java.opts": "-server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.2.0.0-2041", 
>         "yarn.nodemanager.resourcemanager.minimum.version": "NONE", 
>         "yarn.log-aggregation.retain-check-interval-seconds": "-1", 
>         "hadoop.kerberos.kinit.command": "kinit", 
>         "yarn.node-labels.fs-store.root-dir": "/system/yarn/node-labels", 
>         "yarn.nodemanager.linux-container-executor.cgroups.mount": "false", 
>         "yarn.nodemanager.process-kill-wait.ms": "2000", 
>         "mapreduce.jobtracker.handler.count": "10", 
>         "dfs.namenode.name.dir.restore": "true", 
>         "mapreduce.jobhistory.admin.address": "0.0.0.0:10033", 
>         "yarn.app.mapreduce.client-am.ipc.max-retries": "3", 
>         "yarn.app.mapreduce.am.admin-command-opts": "-Dhdp.version=2.2.0.0-2041", 
>         "hadoop.proxyuser.hue.hosts": "*", 
>         "dfs.client.use.datanode.hostname": "false", 
>         "dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction": "0.75f", 
>         "hadoop.util.hash.type": "murmur", 
>         "io.seqfile.lazydecompress": "true", 
>         "dfs.datanode.dns.interface": "default", 
>         "dfs.namenode.lazypersist.file.scrub.interval.sec": "300", 
>         "yarn.client.max-cached-nodemanagers-proxies": "0", 
>         "yarn.nodemanager.disk-health-checker.min-healthy-disks": "0.25", 
>         "mapreduce.job.maxtaskfailures.per.tracker": "3", 
>         "mapreduce.tasktracker.healthchecker.script.timeout": "600000", 
>         "hadoop.security.group.mapping.ldap.search.attr.group.name": "cn", 
>         "hadoop.security.crypto.buffer.size": "8192", 
>         "fs.df.interval": "60000", 
>         "dfs.client.cached.conn.retry": "3", 
>         "dfs.namenode.kerberos.internal.spnego.principal": "${dfs.web.authentication.kerberos.principal}", 
>         "mapreduce.job.reduce.shuffle.consumer.plugin.class": "org.apache.hadoop.mapreduce.task.reduce.Shuffle", 
>         "mapreduce.jobtracker.address": "local", 
>         "mapreduce.tasktracker.tasks.sleeptimebeforesigkill": "5000", 
>         "dfs.journalnode.rpc-address": "0.0.0.0:8485", 
>         "dfs.namenode.fs-limits.max-blocks-per-file": "1048576", 
>         "mapreduce.job.acl-view-job": " ", 
>         "dfs.client.block.write.replace-datanode-on-failure.policy": "DEFAULT", 
>         "yarn.app.mapreduce.am.job.committer.cancel-timeout": "60000", 
>         "mapreduce.shuffle.connection-keep-alive.enable": "false", 
>         "dfs.namenode.replication.interval": "3", 
>         "dfs.namenode.num.checkpoints.retained": "2", 
>         "mapreduce.jobhistory.minicluster.fixed.ports": "false", 
>         "mapreduce.jobhistory.admin.acl": "*", 
>         "mapreduce.tasktracker.http.address": "0.0.0.0:50060", 
>         "yarn.resourcemanager.scheduler.address": "host2:8030", 
>         "dfs.datanode.directoryscan.threads": "1", 
>         "hadoop.security.group.mapping.ldap.ssl": "false", 
>         "mapreduce.reduce.memory.mb": "3584", 
>         "dfs.http.policy": "HTTP_ONLY", 
>         "mapreduce.task.merge.progress.records": "10000", 
>         "yarn.resourcemanager.system-metrics-publisher.dispatcher.pool-size": "10", 
>         "dfs.heartbeat.interval": "3", 
>         "yarn.resourcemanager.recovery.enabled": "false", 
>         "dfs.hosts.exclude": "/etc/hadoop/conf/dfs.exclude", 
>         "net.topology.script.number.args": "100", 
>         "mapreduce.local.clientfactory.class.name": "org.apache.hadoop.mapred.LocalClientFactory", 
>         "dfs.client-write-packet-size": "65536", 
>         "hadoop.security.group.mapping.ldap.directory.search.timeout": "10000", 
>         "dfs.nameservices": "$cluster_name", 
>         "io.native.lib.available": "true", 
>         "dfs.client.failover.connection.retries": "0", 
>         "yarn.nodemanager.disk-health-checker.interval-ms": "120000", 
>         "dfs.blocksize": "134217728", 
>         "dfs.client.use.legacy.blockreader.local": "false", 
>         "yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs": "86400", 
>         "fs.s3a.connection.ssl.enabled": "true", 
>         "mapreduce.jobhistory.webapp.address": "host2:19888", 
>         "yarn.client.failover-retries": "0", 
>         "yarn.resourcemanager.resource-tracker.client.thread-count": "50", 
>         "hadoop.registry.jaas.context": "Client", 
>         "dfs.blockreport.initialDelay": "120", 
>         "yarn.resourcemanager.zk-timeout-ms": "10000", 
>         "ha.health-monitor.rpc-timeout.ms": "45000", 
>         "yarn.nodemanager.aux-services.mapreduce_shuffle.class": "org.apache.hadoop.mapred.ShuffleHandler", 
>         "mapreduce.reduce.markreset.buffer.percent": "0.0", 
>         "dfs.ha.tail-edits.period": "60", 
>         "yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size": "10000", 
>         "mapreduce.admin.user.env": "LD_LIBRARY_PATH=/usr/hdp/2.2.0.0-2041/hadoop/lib/native:/usr/hdp/2.2.0.0-2041/hadoop/lib/native/Linux-amd64-64", 
>         "yarn.nodemanager.health-checker.script.timeout-ms": "60000", 
>         "yarn.resourcemanager.client.thread-count": "50", 
>         "file.bytes-per-checksum": "512", 
>         "dfs.replication.max": "50", 
>         "dfs.namenode.max.extra.edits.segments.retained": "10000", 
>         "yarn.nodemanager.linux-container-executor.group": "hadoop", 
>         "io.map.index.skip": "0", 
>         "mapreduce.jobhistory.bind-host": "0.0.0.0", 
>         "yarn.timeline-service.client.retry-interval-ms": "1000", 
>         "mapreduce.task.timeout": "300000", 
>         "mapreduce.reduce.cpu.vcores": "1", 
>         "dfs.datanode.du.reserved": "1073741824", 
>         "dfs.support.append": "true", 
>         "ftp.blocksize": "67108864", 
>         "dfs.client.file-block-storage-locations.num-threads": "10", 
>         "yarn.nodemanager.container-manager.thread-count": "20", 
>         "ipc.server.listen.queue.size": "128", 
>         "hadoop.ssl.hostname.verifier": "DEFAULT", 
>         "yarn.resourcemanager.ha.automatic-failover.enabled": "true", 
>         "nfs.server.port": "2049", 
>         "mapreduce.tasktracker.dns.interface": "default", 
>         "hadoop.security.group.mapping.ldap.search.attr.member": "member", 
>         "mapreduce.job.userlog.retain.hours": "24", 
>         "mapreduce.tasktracker.outofband.heartbeat": "false", 
>         "fs.s3a.impl": "org.apache.hadoop.fs.s3a.S3AFileSystem", 
>         "yarn.log.server.url": "http://host2:19888/jobhistory/logs", 
>         "hadoop.registry.system.acls": "sasl:yarn@, sasl:mapred@, sasl:mapred@hdfs@", 
>         "yarn.nodemanager.resource.memory-mb": "96768", 
>         "yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds": "-1", 
>         "dfs.webhdfs.user.provider.user.pattern": "^[A-Za-z_][A-Za-z0-9._-]*[$]?$", 
>         "dfs.namenode.delegation.token.renew-interval": "86400000", 
>         "hadoop.ssl.keystores.factory.class": "org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory", 
>         "hadoop.registry.zk.retry.ceiling.ms": "60000", 
>         "yarn.http.policy": "HTTP_ONLY", 
>         "dfs.datanode.sync.behind.writes": "false", 
>         "nfs.wtmax": "1048576", 
>         "fs.AbstractFileSystem.har.impl": "org.apache.hadoop.fs.HarFs", 
>         "dfs.client.read.shortcircuit.skip.checksum": "false", 
>         "hadoop.security.random.device.file.path": "/dev/urandom", 
>         "mapreduce.map.maxattempts": "4", 
>         "yarn.timeline-service.webapp.address": "host2:8188", 
>         "dfs.datanode.handler.count": "10", 
>         "hadoop.ssl.require.client.cert": "false", 
>         "ftp.client-write-packet-size": "65536", 
>         "dfs.client.write.exclude.nodes.cache.expiry.interval.millis": "600000", 
>         "ipc.server.tcpnodelay": "true", 
>         "mapreduce.jobhistory.cleaner.enable": "true", 
>         "fs.du.interval": "600000", 
>         "mapreduce.reduce.shuffle.retry-delay.max.ms": "60000", 
>         "mapreduce.task.profile.reduces": "0-2", 
>         "ha.health-monitor.connect-retry-interval.ms": "1000", 
>         "hadoop.fuse.connection.timeout": "300", 
>         "dfs.permissions.superusergroup": "hdfs", 
>         "mapreduce.jobtracker.jobhistory.task.numberprogresssplits": "12", 
>         "fs.ftp.host.port": "21", 
>         "mapreduce.map.speculative": "false", 
>         "dfs.datanode.data.dir.perm": "750", 
>         "mapreduce.client.submit.file.replication": "10", 
>         "dfs.namenode.startup.delay.block.deletion.sec": "3600", 
>         "s3native.blocksize": "67108864", 
>         "mapreduce.job.ubertask.maxmaps": "9", 
>         "dfs.namenode.replication.min": "1", 
>         "mapreduce.cluster.acls.enabled": "false", 
>         "hadoop.security.uid.cache.secs": "14400", 
>         "nfs.allow.insecure.ports": "true", 
>         "yarn.nodemanager.localizer.fetch.thread-count": "4", 
>         "map.sort.class": "org.apache.hadoop.util.QuickSort", 
>         "hadoop.proxyuser.hue.groups": "*", 
>         "fs.trash.checkpoint.interval": "0", 
>         "hadoop.proxyuser.hcat.groups": "users", 
>         "dfs.image.transfer.timeout": "60000", 
>         "dfs.namenode.name.dir": "/grid/1/dfs/nn,/grid/2/dfs/nn,/grid/3/dfs/nn,/grid/4/dfs/nn,/grid/5/dfs/nn,/grid/6/dfs/nn", 
>         "ipc.client.connect.timeout": "20000", 
>         "yarn.app.mapreduce.am.staging-dir": "/user", 
>         "fs.AbstractFileSystem.file.impl": "org.apache.hadoop.fs.local.LocalFs", 
>         "yarn.nodemanager.env-whitelist": "JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOME", 
>         "hadoop.registry.zk.retry.interval.ms": "1000", 
>         "yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage": "false", 
>         "yarn.timeline-service.keytab": "/etc/krb5.keytab", 
>         "dfs.image.compression.codec": "org.apache.hadoop.io.compress.DefaultCodec", 
>         "mapreduce.job.reduces": "1", 
>         "mapreduce.job.complete.cancel.delegation.tokens": "true", 
>         "mapreduce.jobhistory.recovery.store.class": "org.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreService", 
>         "hadoop.security.group.mapping.ldap.search.filter.user": "(&(objectClass=user)(sAMAccountName={0}))", 
>         "dfs.namenode.enable.retrycache": "true", 
>         "yarn.nodemanager.sleep-delay-before-sigkill.ms": "250", 
>         "mapreduce.jobhistory.joblist.cache.size": "20000", 
>         "mapreduce.tasktracker.healthchecker.interval": "60000", 
>         "mapreduce.jobtracker.heartbeats.in.second": "100", 
>         "hadoop.security.auth_to_local": " RULE:[2:$1@$0]([rn]m@.*)s/.*/yarn/ RULE:[2:$1@$0](jhs@.*)s/.*/mapred/ RULE:[2:$1@$0]([nd]n@.*)s/.*/hdfs/ RULE:[2:$1@$0](hm@.*)s/.*/hbase/ RULE:[2:$1@$0](rs@.*)s/.*/hbase/ DEFAULT", 
>         "mapreduce.admin.map.child.java.opts": "-server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.2.0.0-2041", 
>         "mapreduce.jobtracker.persist.jobstatus.dir": "/jobtracker/jobsInfo", 
>         "dfs.namenode.backup.http-address": "0.0.0.0:50105", 
>         "hadoop.rpc.protection": "authentication", 
>         "dfs.client.mmap.enabled": "true", 
>         "yarn.app.mapreduce.am.container.log.backups": "0", 
>         "ftp.stream-buffer-size": "4096", 
>         "dfs.namenode.https-address": "host1:50470", 
>         "yarn.timeline-service.address": "host2:10200", 
>         "dfs.ha.log-roll.period": "120", 
>         "yarn.nodemanager.recovery.enabled": "true", 
>         "hadoop.security.groups.negative-cache.secs": "30", 
>         "yarn.resourcemanager.admin.client.thread-count": "1", 
>         "dfs.datanode.fsdatasetcache.max.threads.per.volume": "4", 
>         "file.client-write-packet-size": "65536", 
>         "hadoop.http.authentication.simple.anonymous.allowed": "true", 
>         "yarn.timeline-service.leveldb-timeline-store.path": "/grid/1/hadoop/yarn/timeline", 
>         "dfs.namenode.https-address.$cluster_name.nn1": "host1:50470", 
>         "yarn.resourcemanager.proxy-user-privileges.enabled": "false", 
>         "dfs.datanode.drop.cache.behind.reads": "false", 
>         "yarn.nodemanager.log.retain-seconds": "10800", 
>         "dfs.image.transfer.bandwidthPerSec": "0", 
>         "yarn.resourcemanager.work-preserving-recovery.scheduling-wait-ms": "10000", 
>         "hadoop.registry.zk.session.timeout.ms": "60000", 
>         "dfs.datanode.slow.io.warning.threshold.ms": "300", 
>         "mapreduce.tasktracker.instrumentation": "org.apache.hadoop.mapred.TaskTrackerMetricsInst", 
>         "ha.failover-controller.cli-check.rpc-timeout.ms": "20000", 
>         "dfs.namenode.https-address.$cluster_name.nn2": "host2:50470", 
>         "yarn.nodemanager.linux-container-executor.cgroups.hierarchy": "hadoop-yarn", 
>         "dfs.namenode.write.stale.datanode.ratio": "1.0f", 
>         "hadoop.security.groups.cache.warn.after.ms": "5000", 
>         "mapreduce.reduce.shuffle.fetch.retry.timeout-ms": "30000", 
>         "mapreduce.jobhistory.client.thread-count": "10", 
>         "io.mapfile.bloom.size": "1048576", 
>         "yarn.resourcemanager.work-preserving-recovery.enabled": "true", 
>         "dfs.ha.fencing.ssh.connect-timeout": "30000", 
>         "yarn.resourcemanager.zk-num-retries": "1000", 
>         "hadoop.registry.zk.root": "/registry", 
>         "s3.bytes-per-checksum": "512", 
>         "yarn.app.mapreduce.am.container.log.limit.kb": "0", 
>         "dfs.namenode.edit.log.autoroll.check.interval.ms": "300000", 
>         "fs.automatic.close": "true", 
>         "yarn.node-labels.fs-store.retry-policy-spec": "2000, 500", 
>         "fs.trash.interval": "360", 
>         "dfs.journalnode.https-address": "0.0.0.0:8481", 
>         "yarn.timeline-service.ttl-ms": "2678400000", 
>         "hadoop.security.authentication": "simple", 
>         "fs.defaultFS": "hdfs://$cluster_name", 
>         "nfs.rtmax": "1048576", 
>         "hadoop.ssl.server.conf": "ssl-server.xml", 
>         "ipc.client.connect.max.retries": "50", 
>         "yarn.resourcemanager.delayed.delegation-token.removal-interval-ms": "30000", 
>         "dfs.journalnode.http-address": "0.0.0.0:8480", 
>         "dfs.namenode.xattrs.enabled": "true", 
>         "dfs.datanode.shared.file.descriptor.paths": "/dev/shm,/tmp", 
>         "mapreduce.jobtracker.taskscheduler": "org.apache.hadoop.mapred.JobQueueTaskScheduler", 
>         "mapreduce.job.speculative.speculativecap": "0.1", 
>         "yarn.timeline-service.store-class": "org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore", 
>         "yarn.am.liveness-monitor.expiry-interval-ms": "600000", 
>         "mapreduce.output.fileoutputformat.compress": "false", 
>         "yarn.timeline-service.bind-host": "0.0.0.0", 
>         "dfs.user.home.dir.prefix": "/user", 
>         "yarn.app.mapreduce.am.log.level": "INFO", 
>         "net.topology.node.switch.mapping.impl": "org.apache.hadoop.net.ScriptBasedMapping", 
>         "dfs.namenode.replication.considerLoad": "true", 
>         "dfs.namenode.fs-limits.min-block-size": "1048576", 
>         "fs.swift.impl": "org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem", 
>         "dfs.namenode.audit.loggers": "default", 
>         "yarn.nodemanager.bind-host": "0.0.0.0", 
>         "mapreduce.job.max.split.locations": "10", 
>         "yarn.resourcemanager.address": "host2:8050", 
>         "mapreduce.job.counters.max": "120", 
>         "mapreduce.reduce.shuffle.fetch.retry.enabled": "1", 
>         "dfs.client.block.write.retries": "3", 
>         "dfs.short.circuit.shared.memory.watcher.interrupt.check.ms": "60000", 
>         "dfs.namenode.resource.checked.volumes.minimum": "1", 
>         "io.map.index.interval": "128", 
>         "mapred.child.java.opts": "-Xmx200m", 
>         "mapreduce.tasktracker.local.dir.minspacestart": "0", 
>         "mapreduce.client.progressmonitor.pollinterval": "1000", 
>         "dfs.client.https.keystore.resource": "ssl-client.xml", 
>         "mapreduce.task.profile.map.params": "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s", 
>         "mapreduce.jobtracker.tasktracker.maxblacklists": "4", 
>         "mapreduce.job.queuename": "default", 
>         "hadoop.registry.zk.quorum": "host2:2181", 
>         "yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts": "3", 
>         "yarn.nodemanager.localizer.address": "0.0.0.0:8040", 
>         "io.mapfile.bloom.error.rate": "0.005", 
>         "yarn.nodemanager.delete.thread-count": "4", 
>         "mapreduce.job.split.metainfo.maxsize": "10000000", 
>         "yarn.scheduler.maximum-allocation-vcores": "32", 
>         "dfs.https.port": "50470", 
>         "yarn.app.mapreduce.am.resource.mb": "3584", 
>         "dfs.datanode.dns.nameserver": "default", 
>         "dfs.client.slow.io.warning.threshold.ms": "30000", 
>         "mapreduce.job.reducer.preempt.delay.sec": "0", 
>         "yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb": "1000", 
>         "mapreduce.map.output.compress.codec": "org.apache.hadoop.io.compress.DefaultCodec", 
>         "dfs.namenode.accesstime.precision": "0", 
>         "mapreduce.map.log.level": "INFO", 
>         "fs.s3a.connection.maximum": "15", 
>         "io.seqfile.compress.blocksize": "1000000", 
>         "mapreduce.tasktracker.taskcontroller": "org.apache.hadoop.mapred.DefaultTaskController", 
>         "hadoop.security.groups.cache.secs": "300", 
>         "dfs.datanode.cache.revocation.timeout.ms": "900000", 
>         "dfs.client.context": "default", 
>         "hadoop.proxyuser.hive.groups": "users", 
>         "mapreduce.input.lineinputformat.linespermap": "1", 
>         "mapreduce.job.end-notification.max.attempts": "5", 
>         "yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user": "nobody", 
>         "yarn.nodemanager.webapp.address": "0.0.0.0:8042", 
>         "mapreduce.jobhistory.recovery.enable": "false", 
>         "mapreduce.jobtracker.expire.trackers.interval": "600000", 
>         "yarn.resourcemanager.webapp.address": "host2:8088", 
>         "hadoop.security.kms.client.encrypted.key.cache.num.refill.threads": "2", 
>         "yarn.nodemanager.health-checker.interval-ms": "135000", 
>         "mapreduce.jobhistory.loadedjobs.cache.size": "5", 
>         "hadoop.security.authorization": "false", 
>         "mapreduce.job.map.output.collector.class": "org.apache.hadoop.mapred.MapTask$MapOutputBuffer", 
>         "mapreduce.am.max-attempts": "2", 
>         "fs.ftp.host": "0.0.0.0", 
>         "fs.s3a.attempts.maximum": "10", 
>         "yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms": "1000", 
>         "mapreduce.ifile.readahead": "true", 
>         "yarn.resourcemanager.scheduler.monitor.enable": "false", 
>         "yarn.resourcemanager.zk-retry-interval-ms": "1000", 
>         "ha.zookeeper.session-timeout.ms": "5000", 
>         "rpc.engine.org.apache.hadoop.ipc.ProtocolMetaInfoPB": "org.apache.hadoop.ipc.ProtobufRpcEngine", 
>         "mapreduce.tasktracker.taskmemorymanager.monitoringinterval": "5000", 
>         "mapreduce.reduce.shuffle.parallelcopies": "30", 
>         "mapreduce.map.skip.maxrecords": "0", 
>         "dfs.client.mmap.retry.timeout.ms": "300000", 
>         "dfs.namenode.avoid.read.stale.datanode": "true", 
>         "yarn.timeline-service.webapp.https.address": "host2:8190", 
>         "dfs.https.enable": "false", 
>         "mapreduce.reduce.shuffle.read.timeout": "180000", 
>         "dfs.namenode.list.encryption.zones.num.responses": "100", 
>         "mapreduce.jobtracker.instrumentation": "org.apache.hadoop.mapred.JobTrackerMetricsInst", 
>         "mapreduce.output.fileoutputformat.compress.codec": "org.apache.hadoop.io.compress.DefaultCodec", 
>         "yarn.nodemanager.remote-app-log-dir-suffix": "logs", 
>         "ipc.client.connect.retry.interval": "1000", 
>         "dfs.blockreport.intervalMsec": "21600000", 
>         "mapreduce.reduce.speculative": "false", 
>         "mapreduce.jobhistory.keytab": "/etc/security/keytab/jhs.service.keytab", 
>         "mapreduce.jobhistory.datestring.cache.size": "200000", 
>         "dfs.datanode.balance.bandwidthPerSec": "6250000", 
>         "file.blocksize": "67108864", 
>         "yarn.resourcemanager.admin.address": "host2:8141", 
>         "mapreduce.map.cpu.vcores": "1", 
>         "yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled": "false", 
>         "yarn.resourcemanager.resource-tracker.address": "host2:8025", 
>         "yarn.resourcemanager.configuration.provider-class": "org.apache.hadoop.yarn.LocalConfigurationProvider", 
>         "mapreduce.tasktracker.local.dir.minspacekill": "0", 
>         "mapreduce.jobtracker.staging.root.dir": "/tmp/hadoop-yarn-${hue.suffix}/mapred/staging", 
>         "mapreduce.jobtracker.retiredjobs.cache.size": "1000", 
>         "hadoop.registry.rm.enabled": "true", 
>         "dfs.ha.fencing.methods": "shell(/bin/true)", 
>         "ipc.client.connect.max.retries.on.timeouts": "45", 
>         "hadoop.security.crypto.codec.classes.aes.ctr.nopadding": "org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec,org.apache.hadoop.crypto.JceAesCtrCryptoCodec", 
>         "ha.zookeeper.acl": "world:anyone:rwcda", 
>         "mapreduce.app-submission.cross-platform": "false", 
>         "yarn.nodemanager.local-dirs": "/grid/1/hadoop/yarn/local,/grid/2/hadoop/yarn/local,/grid/3/hadoop/yarn/local,/grid/4/hadoop/yarn/local,/grid/5/hadoop/yarn/local,/grid/6/hadoop/yarn/local", 
>         "rpc.metrics.quantile.enable": "false", 
>         "dfs.block.access.key.update.interval": "600", 
>         "mapreduce.reduce.shuffle.connect.timeout": "180000", 
>         "dfs.block.access.token.lifetime": "600", 
>         "mapreduce.job.end-notification.retry.attempts": "0", 
>         "dfs.namenode.fs-limits.max-xattrs-per-inode": "32", 
>         "mapreduce.jobtracker.system.dir": "/tmp/hadoop-yarn-${hue.suffix}/mapred/system", 
>         "dfs.client.file-block-storage-locations.timeout.millis": "1000", 
>         "yarn.nodemanager.admin-env": "MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX", 
>         "yarn.log-aggregation.retain-seconds": "2592000", 
>         "mapreduce.jobtracker.jobhistory.block.size": "3145728", 
>         "yarn.timeline-service.handler-thread-count": "10", 
>         "mapreduce.tasktracker.indexcache.mb": "10", 
>         "dfs.namenode.checkpoint.check.period": "60", 
>         "dfs.client.block.write.replace-datanode-on-failure.enable": "true", 
>         "yarn.resourcemanager.hostname": "host2", 
>         "dfs.datanode.directoryscan.interval": "21600", 
>         "net.topology.impl": "org.apache.hadoop.net.NetworkTopology", 
>         "fs.s3a.multipart.purge.age": "86400", 
>         "dfs.client.failover.proxy.provider.$cluster_name": "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider", 
>         "hadoop.security.java.secure.random.algorithm": "SHA1PRNG", 
>         "yarn.nodemanager.container-monitor.interval-ms": "3000", 
>         "dfs.default.chunk.view.size": "32768", 
>         "fs.s3a.multipart.threshold": "2147483647", 
>         "mapreduce.job.speculative.slownodethreshold": "1.0", 
>         "mapreduce.job.reduce.slowstart.completedmaps": "0.05", 
>         "hadoop.security.instrumentation.requires.admin": "false", 
>         "io.compression.codec.bzip2.library": "system-native", 
>         "dfs.namenode.safemode.min.datanodes": "0", 
>         "hadoop.registry.secure": "false", 
>         "hadoop.http.authentication.signature.secret.file": "/home/yarn/hadoop-http-auth-signature-secret", 
>         "mapreduce.reduce.maxattempts": "4", 
>         "yarn.nodemanager.localizer.cache.target-size-mb": "10240", 
>         "s3native.replication": "3", 
>         "dfs.datanode.https.address": "0.0.0.0:50475", 
>         "dfs.journalnode.edits.dir": "/grid/1/dfs/journal,/grid/2/dfs/journal,/grid/3/dfs/journal,/grid/4/dfs/journal,/grid/5/dfs/journal,/grid/6/dfs/journal", 
>         "dfs.namenode.path.based.cache.retry.interval.ms": "30000", 
>         "dfs.namenode.inotify.max.events.per.rpc": "1000", 
>         "dfs.datanode.cache.revocation.polling.ms": "500", 
>         "mapreduce.reduce.skip.proc.count.autoincr": "true", 
>         "file.replication": "1", 
>         "mapreduce.jobhistory.cleaner.interval-ms": "86400000", 
>         "hadoop.hdfs.configuration.version": "1", 
>         "ipc.client.idlethreshold": "8000", 
>         "yarn.resourcemanager.store.class": "org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore", 
>         "hadoop.tmp.dir": "/tmp/hadoop-yarn-${hue.suffix}", 
>         "mapreduce.jobtracker.restart.recover": "false", 
>         "mapreduce.jobhistory.address": "host2:10020", 
>         "mapreduce.cluster.local.dir": "/tmp/hadoop-yarn-${hue.suffix}/mapred/local", 
>         "yarn.client.nodemanager-client-async.thread-pool-max-size": "500", 
>         "proxyuser_group": "users", 
>         "dfs.namenode.decommission.nodes.per.interval": "5", 
>         "dfs.namenode.reject-unresolved-dn-topology-mapping": "false", 
>         "yarn.nodemanager.resource.cpu-vcores": "20", 
>         "dfs.namenode.delegation.key.update-interval": "86400000", 
>         "dfs.client.read.shortcircuit.streams.cache.expiry.ms": "300000", 
>         "fs.s3.buffer.dir": "/tmp/hadoop-yarn-${hue.suffix}/s3", 
>         "dfs.namenode.support.allow.format": "true", 
>         "yarn.nodemanager.remote-app-log-dir": "/app-logs", 
>         "io.compression.codecs": "org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.SnappyCodec", 
>         "yarn.nodemanager.aux-services": "mapreduce_shuffle", 
>         "dfs.namenode.edit.log.autoroll.multiplier.threshold": "2.0", 
>         "mapreduce.map.memory.mb": "3584", 
>         "hadoop.work.around.non.threadsafe.getpwuid": "false", 
>         "mapreduce.task.profile.reduce.params": "-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s", 
>         "dfs.ha.automatic-failover.enabled": "true", 
>         "yarn.timeline-service.client.max-retries": "30", 
>         "dfs.namenode.stale.datanode.interval": "30000", 
>         "dfs.namenode.edits.noeditlogchannelflush": "false", 
>         "mapreduce.shuffle.transfer.buffer.size": "131072", 
>         "dfs.namenode.logging.level": "info", 
>         "mapreduce.jobtracker.persist.jobstatus.active": "true", 
>         "yarn.nodemanager.log-dirs": "/var/log/hadoop-yarn", 
>         "yarn.resourcemanager.am-rm-tokens.master-key-rolling-interval-secs": "86400", 
>         "ha.health-monitor.sleep-after-disconnect.ms": "1000", 
>         "dfs.namenode.checkpoint.edits.dir": "/grid/1/dfs/snn,/grid/2/dfs/snn,/grid/3/dfs/snn,/grid/4/dfs/snn,/grid/5/dfs/snn,/grid/6/dfs/snn", 
>         "yarn.resourcemanager.fs.state-store.uri": " ", 
>         "hadoop.rpc.socket.factory.class.default": "org.apache.hadoop.net.StandardSocketFactory", 
>         "yarn.resourcemanager.keytab": "/etc/krb5.keytab", 
>         "dfs.datanode.http.address": "0.0.0.0:50075", 
>         "mapreduce.task.profile": "false", 
>         "mapreduce.jobhistory.move.interval-ms": "180000", 
>         "dfs.namenode.edits.dir": "/grid/1/dfs/nn,/grid/2/dfs/nn,/grid/3/dfs/nn,/grid/4/dfs/nn,/grid/5/dfs/nn,/grid/6/dfs/nn", 
>         "dfs.storage.policy.enabled": "true", 
>         "hadoop.security.kms.client.encrypted.key.cache.size": "500", 
>         "hadoop.fuse.timer.period": "5", 
>         "mapreduce.jobhistory.http.policy": "HTTP_ONLY", 
>         "mapreduce.jobhistory.intermediate-done-dir": "/mr-history/tmp", 
>         "mapreduce.map.skip.proc.count.autoincr": "true", 
>         "dfs.cluster.administrators": " hdfs", 
>         "fs.AbstractFileSystem.viewfs.impl": "org.apache.hadoop.fs.viewfs.ViewFs", 
>         "mapreduce.job.speculative.slowtaskthreshold": "1.0", 
>         "yarn.resourcemanager.webapp.delegation-token-auth-filter.enabled": "false", 
>         "s3native.stream-buffer-size": "4096", 
>         "yarn.nodemanager.delete.debug-delay-sec": "0", 
>         "dfs.secondary.namenode.kerberos.internal.spnego.principal": "${dfs.web.authentication.kerberos.principal}", 
>         "dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold": "10737418240", 
>         "fs.s3n.multipart.uploads.block.size": "67108864", 
>         "mapreduce.ifile.readahead.bytes": "4194304", 
>         "dfs.namenode.safemode.threshold-pct": "0.99f", 
>         "yarn.scheduler.maximum-allocation-mb": "96768", 
>         "ipc.client.fallback-to-simple-auth-allowed": "false", 
>         "yarn.timeline-service.leveldb-timeline-store.read-cache-size": "104857600", 
>         "fs.har.impl.disable.cache": "true", 
>         "s3native.bytes-per-checksum": "512", 
>         "yarn.timeline-service.hostname": "0.0.0.0", 
>         "mapreduce.job.committer.setup.cleanup.needed": "true", 
>         "fs.s3a.paging.maximum": "5000", 
>         "yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms": "300000", 
>         "yarn.client.nodemanager-connect.retry-interval-ms": "10000", 
>         "yarn.nodemanager.log-aggregation.compression-type": "gz", 
>         "yarn.app.mapreduce.am.job.committer.commit-window": "10000", 
>         "hadoop.http.authentication.type": "simple", 
>         "dfs.client.failover.sleep.base.millis": "500", 
>         "dfs.ha.namenodes.$cluster_name": "nn1,nn2", 
>         "yarn.nodemanager.vmem-check-enabled": "false", 
>         "hadoop.jetty.logs.serve.aliases": "true", 
>         "ha.failover-controller.graceful-fence.rpc-timeout.ms": "5000", 
>         "mapreduce.reduce.shuffle.input.buffer.percent": "0.7", 
>         "dfs.datanode.max.transfer.threads": "4096", 
>         "mapreduce.task.io.sort.mb": "1024", 
>         "mapreduce.reduce.merge.inmem.threshold": "1000", 
>         "hadoop.security.kms.client.authentication.retry-count": "1", 
>         "yarn.client.application-client-protocol.poll-interval-ms": "200", 
>         "dfs.namenode.acls.enabled": "false", 
>         "yarn.resourcemanager.connect.max-wait.ms": "900000", 
>         "dfs.namenode.handler.count": "40", 
>         "yarn.timeline-service.enabled": "true", 
>         "dfs.namenode.retrycache.heap.percent": "0.03f", 
>         "yarn.nodemanager.log.retain-second": "604800", 
>         "yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users": "true", 
>         "yarn.resourcemanager.container.liveness-monitor.interval-ms": "600000", 
>         "hadoop.ssl.client.conf": "ssl-client.xml", 
>         "mapreduce.client.completion.pollinterval": "5000", 
>         "yarn.nodemanager.vmem-pmem-ratio": "2.1", 
>         "yarn.app.mapreduce.client.max-retries": "3", 
>         "hadoop.ssl.enabled": "false", 
>         "fs.AbstractFileSystem.hdfs.impl": "org.apache.hadoop.fs.Hdfs", 
>         "fs.client.resolve.remote.symlinks": "true", 
>         "mapreduce.reduce.java.opts": "-Xmx2867m", 
>         "mapreduce.map.java.opts": "-Xmx2867m", 
>         "mapreduce.tasktracker.reduce.tasks.maximum": "2", 
>         "yarn.nodemanager.hostname": "0.0.0.0", 
>         "mapreduce.reduce.input.buffer.percent": "0.0", 
>         "fs.s3a.multipart.purge": "false", 
>         "dfs.namenode.invalidate.work.pct.per.iteration": "0.32f", 
>         "yarn.app.mapreduce.am.command-opts": "-Xmx2867m -Dhdp.version=2.2.0.0-2041", 
>         "dfs.bytes-per-checksum": "512", 
>         "dfs.replication": "3", 
>         "yarn.resourcemanager.webapp.https.address": "host2:8090", 
>         "mapreduce.shuffle.ssl.file.buffer.size": "65536", 
>         "dfs.datanode.block.id.layout.upgrade.threads": "12", 
>         "dfs.namenode.list.cache.directives.num.responses": "100", 
>         "dfs.permissions.enabled": "true", 
>         "mapreduce.jobtracker.maxtasks.perjob": "-1", 
>         "dfs.datanode.use.datanode.hostname": "false", 
>         "mapreduce.task.userlog.limit.kb": "0", 
>         "dfs.namenode.fs-limits.max-directory-items": "1048576", 
>         "s3.client-write-packet-size": "65536", 
>         "fs.s3a.buffer.dir": "/tmp/hadoop-yarn-${hue.suffix}/s3a", 
>         "hadoop.security.kms.client.encrypted.key.cache.low-watermark": "0.3f", 
>         "hadoop.user.group.static.mapping.overrides": "dr.who=;", 
>         "slider.provider.agent": "org.apache.slider.providers.agent.AgentProviderFactory", 
>         "mapreduce.shuffle.max.threads": "0", 
>         "dfs.client.failover.sleep.max.millis": "15000", 
>         "hadoop.security.kms.client.encrypted.key.cache.expiry": "43200000", 
>         "mapreduce.job.maps": "2", 
>         "dfs.namenode.fs-limits.max-component-length": "255", 
>         "hadoop.ssl.enabled.protocols": "TLSv1", 
>         "mapreduce.map.output.compress": "false", 
>         "s3.blocksize": "67108864", 
>         "dfs.namenode.edits.journal-plugin.qjournal": "org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager", 
>         "dfs.namenode.datanode.registration.ip-hostname-check": "true", 
>         "yarn.node-labels.manager-class": "org.apache.hadoop.yarn.server.resourcemanager.nodelabels.MemoryRMNodeLabelsManager", 
>         "yarn.nodemanager.pmem-check-enabled": "true", 
>         "dfs.client.https.need-auth": "false", 
>         "dfs.client.short.circuit.replica.stale.threshold.ms": "1800000", 
>         "ha.zookeeper.quorum": "host1:2181,host2:2181,host3:2181", 
>         "yarn.scheduler.minimum-allocation-mb": "3584", 
>         "hadoop.proxyuser.hive.hosts": "host1", 
>         "yarn.timeline-service.http-authentication.type": "simple", 
>         "mapreduce.jobhistory.max-age-ms": "604800000", 
>         "ftp.replication": "3", 
>         "dfs.blockreport.split.threshold": "1000000", 
>         "dfs.namenode.secondary.https-address": "0.0.0.0:50091", 
>         "mapreduce.input.fileinputformat.split.minsize": "0", 
>         "fs.s3n.block.size": "67108864", 
>         "mapreduce.job.token.tracking.ids.enabled": "false", 
>         "mapreduce.jobtracker.webinterface.trusted": "false", 
>         "yarn.ipc.rpc.class": "org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC", 
>         "dfs.namenode.num.extra.edits.retained": "1000000", 
>         "hadoop.http.staticuser.user": "dr.who", 
>         "yarn.nodemanager.localizer.cache.cleanup.interval-ms": "600000", 
>         "mapreduce.job.jvm.numtasks": "1", 
>         "fs.s3a.multipart.size": "104857600", 
>         "mapreduce.jobhistory.move.thread-count": "3", 
>         "mapreduce.task.profile.maps": "0-2", 
>         "dfs.datanode.max.locked.memory": "0", 
>         "dfs.cachereport.intervalMsec": "10000", 
>         "mapreduce.shuffle.port": "13562", 
>         "mapreduce.shuffle.connection-keep-alive.timeout": "5", 
>         "yarn.resourcemanager.nodemanager.minimum.version": "NONE", 
>         "mapreduce.jobtracker.http.address": "0.0.0.0:50030", 
>         "mapreduce.reduce.shuffle.merge.percent": "0.66", 
>         "yarn.resourcemanager.connect.retry-interval.ms": "30000", 
>         "mapreduce.task.skip.start.attempts": "2", 
>         "yarn.scheduler.minimum-allocation-vcores": "1", 
>         "mapreduce.task.io.sort.factor": "100", 
>         "dfs.namenode.checkpoint.dir": "/grid/1/dfs/snn,/grid/2/dfs/snn,/grid/3/dfs/snn,/grid/4/dfs/snn,/grid/5/dfs/snn,/grid/6/dfs/snn", 
>         "nfs.exports.allowed.hosts": "* rw", 
>         "tfile.fs.input.buffer.size": "262144", 
>         "tfile.io.chunk.size": "1048576", 
>         "fs.s3.block.size": "67108864", 
>         "fs.s3n.multipart.copy.block.size": "5368709120", 
>         "io.serializations": "org.apache.hadoop.io.serializer.WritableSerialization", 
>         "yarn.resourcemanager.max-completed-applications": "10000", 
>         "mapreduce.jobhistory.principal": "jhs/_HOST@REALM.TLD", 
>         "hadoop.proxyuser.hcat.hosts": "host1", 
>         "yarn.resourcemanager.ha.automatic-failover.zk-base-path": "/yarn-leader-election", 
>         "mapreduce.reduce.shuffle.fetch.retry.interval-ms": "1000", 
>         "mapreduce.job.end-notification.retry.interval": "1000", 
>         "mapreduce.application.framework.path": "/hdp/apps/2.2.0.0-2041/mapreduce/mapreduce.tar.gz#mr-framework", 
>         "dfs.namenode.backup.address": "0.0.0.0:50100", 
>         "fs.s3n.multipart.uploads.enabled": "false", 
>         "s3native.client-write-packet-size": "65536", 
>         "dfs.block.access.token.enable": "true", 
>         "io.seqfile.sorter.recordlimit": "1000000", 
>         "hadoop.security.group.mapping": "org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback", 
>         "ftp.bytes-per-checksum": "512", 
>         "dfs.namenode.fs-limits.max-xattr-size": "16384", 
>         "dfs.client.read.shortcircuit.streams.cache.size": "4096", 
>         "dfs.client.domain.socket.data.traffic": "false", 
>         "fs.s3a.connection.timeout": "5000", 
>         "mapreduce.job.end-notification.max.retry.interval": "5000", 
>         "dfs.namenode.rpc-address.$cluster_name.nn1": "host1:8020", 
>         "yarn.acl.enable": "false", 
>         "mapreduce.application.classpath": "$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.2.0.0-2041/hadoop/lib/hadoop-lzo-0.6.0.2.2.0.0-2041.jar:/etc/hadoop/conf/secure", 
>         "yarn.nm.liveness-monitor.expiry-interval-ms": "600000", 
>         "dfs.namenode.rpc-address.$cluster_name.nn2": "host2:8020", 
>         "dfs.client.mmap.cache.size": "256", 
>         "mapreduce.input.fileinputformat.list-status.num-threads": "1", 
>         "mapreduce.tasktracker.map.tasks.maximum": "2", 
>         "yarn.nodemanager.linux-container-executor.resources-handler.class": "org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler", 
>         "yarn.timeline-service.ttl-enable": "true", 
>         "yarn.resourcemanager.zk-address": "localhost:2181", 
>         "dfs.namenode.max.objects": "0", 
>         "yarn.resourcemanager.state-store.max-completed-applications": "10000", 
>         "dfs.namenode.delegation.token.max-lifetime": "604800000", 
>         "mapreduce.job.classloader": "false", 
>         "yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size": "10000", 
>         "mapreduce.job.hdfs-servers": "hdfs://$cluster_name", 
>         "yarn.application.classpath": "$HADOOP_CONF_DIR,/usr/hdp/current/hadoop-client/*,/usr/hdp/current/hadoop-client/lib/*,/usr/hdp/current/hadoop-hdfs-client/*,/usr/hdp/current/hadoop-hdfs-client/lib/*,/usr/hdp/current/hadoop-yarn-client/*,/usr/hdp/current/hadoop-yarn-client/lib/*", 
>         "mapreduce.tasktracker.dns.nameserver": "default", 
>         "dfs.datanode.hdfs-blocks-metadata.enabled": "false", 
>         "dfs.datanode.readahead.bytes": "4193404", 
>         "dfs.image.compress": "false", 
>         "mapreduce.job.ubertask.maxreduces": "1", 
>         "mapreduce.tasktracker.report.address": "127.0.0.1:0", 
>         "yarn.log-aggregation-enable": "true", 
>         "mapreduce.shuffle.ssl.enabled": "false", 
>         "rpc.engine.org.apache.slider.server.appmaster.rpc.SliderClusterProtocolPB": "org.apache.hadoop.ipc.ProtobufRpcEngine", 
>         "mapreduce.tasktracker.http.threads": "40", 
>         "dfs.stream-buffer-size": "4096", 
>         "tfile.fs.output.buffer.size": "262144", 
>         "fs.permissions.umask-mode": "022", 
>         "yarn.resourcemanager.am.max-attempts": "2", 
>         "dfs.namenode.resource.du.reserved": "104857600", 
>         "dfs.client.datanode-restart.timeout": "30", 
>         "yarn.nodemanager.resource.percentage-physical-cpu-limit": "100", 
>         "ha.failover-controller.graceful-fence.connection.retries": "1", 
>         "dfs.datanode.drop.cache.behind.writes": "false", 
>         "yarn.app.mapreduce.am.resource.cpu-vcores": "1", 
>         "mapreduce.job.ubertask.enable": "false", 
>         "hadoop.common.configuration.version": "0.23.0", 
>         "dfs.namenode.replication.work.multiplier.per.iteration": "2", 
>         "mapreduce.job.acl-modify-job": " ", 
>         "io.seqfile.local.dir": "/tmp/hadoop-yarn-${hue.suffix}/io/local", 
>         "fs.s3.sleepTimeSeconds": "10", 
>         "yarn.resourcemanager.system-metrics-publisher.enabled": "true", 
>         "mapreduce.client.output.filter": "FAILED"
>     }, 
>     "empty": false
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message