hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yoonmin Nam" <rony...@dgist.ac.kr>
Subject About java heap space error in MR applicaiton over YARN
Date Wed, 30 Oct 2013 07:17:36 GMT
Hi

 

I tried to run some finding connected component algorithm on hadoop 2.2.0
using yarn.

 

This mapreduce application ran correctly over the hadoop 1.2.1.

 

However, when I tried to run this algorithm using yarn, above error messages
are printed:

 

13/10/30 14:18:25 INFO mapreduce.Job: Task Id :

attempt_1383065659051_0002_m_000022_0, Status : FAILED

 

Error: Java heap space

 

Container killed by the ApplicationMaster.

 

Container killed on request. Exit code is 143

 

 

 

There are 179 inputsplits so total 179 containers were created.

 

Here is some part of log (applicationmaster):

 

 

2013-10-30 14:18:18,146 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for
application appattempt_1383065659051_0002_000001

2013-10-30 14:18:18,323 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval;  Ignoring.

2013-10-30 14:18:18,323 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts;  Ignoring.

2013-10-30 14:18:18,459 WARN [main] org.apache.hadoop.util.NativeCodeLoader:
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable

2013-10-30 14:18:18,467 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:

2013-10-30 14:18:18,467 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN,
Service: , Ident:
(org.apache.hadoop.yarn.security.AMRMTokenIdentifier@374f279c
<mailto:org.apache.hadoop.yarn.security.AMRMTokenIdentifier@374f279c> )

2013-10-30 14:18:18,492 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: The specific max attempts: 2
for application: 2. Attempt num: 1 is last retry: false

2013-10-30 14:18:18,505 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred
newApiCommitter.

2013-10-30 14:18:18,570 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval;  Ignoring.

2013-10-30 14:18:18,570 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts;  Ignoring.

2013-10-30 14:18:18,866 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
config null

2013-10-30 14:18:18,905 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

2013-10-30 14:18:18,917 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.jobhistory.EventType for class
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler

2013-10-30 14:18:18,918 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher

2013-10-30 14:18:18,918 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher

2013-10-30 14:18:18,919 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher

2013-10-30 14:18:18,919 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler

2013-10-30 14:18:18,922 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher

2013-10-30 14:18:18,923 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter

2013-10-30 14:18:18,923 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter

2013-10-30 14:18:18,980 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler

2013-10-30 14:18:19,171 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties

2013-10-30 14:18:19,206 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
at 10 second(s).

2013-10-30 14:18:19,206 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
system started

2013-10-30 14:18:19,213 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for
job_1383065659051_0002 to jobTokenSecretManager

2013-10-30 14:18:19,304 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
job_1383065659051_0002 because: not enabled; too many maps; too many
reduces; too much input;

2013-10-30 14:18:19,325 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job
job_1383065659051_0002 = 23996376600. Number of splits = 179

2013-10-30 14:18:19,327 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for
job job_1383065659051_0002 = 39

2013-10-30 14:18:19,327 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1383065659051_0002Job Transitioned from NEW to INITED

2013-10-30 14:18:19,328 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
normal, non-uberized, multi-container job job_1383065659051_0002.

2013-10-30 14:18:19,372 INFO [Socket Reader #1 for port 47129]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 47129

2013-10-30 14:18:19,382 INFO [main]
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding
protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server

2013-10-30 14:18:19,383 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting

2013-10-30 14:18:19,383 INFO [IPC Server listener on 47129]
org.apache.hadoop.ipc.Server: IPC Server listener on 47129: starting

2013-10-30 14:18:19,383 INFO [main]
org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated
MRClientService at saturn05/10.40.3.78:47129

2013-10-30 14:18:19,407 INFO [main] org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog

2013-10-30 14:18:19,435 INFO [main] org.apache.hadoop.http.HttpServer: Added
global filter 'safety'
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)

2013-10-30 14:18:19,443 INFO [main] org.apache.hadoop.http.HttpServer: Added
filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context mapreduce

2013-10-30 14:18:19,443 INFO [main] org.apache.hadoop.http.HttpServer: Added
filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context static

2013-10-30 14:18:19,445 INFO [main] org.apache.hadoop.http.HttpServer:
adding path spec: /mapreduce/*

2013-10-30 14:18:19,445 INFO [main] org.apache.hadoop.http.HttpServer:
adding path spec: /ws/*

2013-10-30 14:18:19,446 INFO [main] org.apache.hadoop.http.HttpServer: Jetty
bound to port 43582

2013-10-30 14:18:19,446 INFO [main] org.mortbay.log: jetty-6.1.26

2013-10-30 14:18:19,463 INFO [main] org.mortbay.log: Extract
jar:file:/home/hadoop/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.
0.jar!/webapps/mapreduce to
/tmp/Jetty_0_0_0_0_43582_mapreduce____.t08j13/webapp

2013-10-30 14:18:19,600 INFO [main] org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:43582
<mailto:SelectChannelConnector@0.0.0.0:43582> 

2013-10-30 14:18:19,601 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
Web app /mapreduce started at 43582

2013-10-30 14:18:19,811 INFO [main] org.apache.hadoop.yarn.webapp.WebApps:
Registered webapp guice modules

2013-10-30 14:18:19,812 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE
job_1383065659051_0002

2013-10-30 14:18:19,814 INFO [Socket Reader #1 for port 44262]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 44262

2013-10-30 14:18:19,816 INFO [IPC Server listener on 44262]
org.apache.hadoop.ipc.Server: IPC Server listener on 44262: starting

2013-10-30 14:18:19,816 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting

2013-10-30 14:18:19,827 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
nodeBlacklistingEnabled:true

2013-10-30 14:18:19,827 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
maxTaskFailuresPerNode is 3

2013-10-30 14:18:19,827 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
blacklistDisablePercent is 33

2013-10-30 14:18:19,851 INFO [main] org.apache.hadoop.yarn.client.RMProxy:
Connecting to ResourceManager at /10.40.3.56:8031

2013-10-30 14:18:19,873 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
maxContainerCapability: 8192

2013-10-30 14:18:19,874 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper
limit on the thread pool size is 500

2013-10-30 14:18:19,882 INFO [main]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
yarn.client.max-nodemanagers-proxies : 500

2013-10-30 14:18:19,886 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1383065659051_0002Job Transitioned from INITED to SETUP

2013-10-30 14:18:19,887 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: JOB_SETUP

2013-10-30 14:18:19,937 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1383065659051_0002Job Transitioned from SETUP to RUNNING

2013-10-30 14:18:19,972 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn08 to /default-rack

2013-10-30 14:18:19,978 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn06 to /default-rack

2013-10-30 14:18:19,978 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn09 to /default-rack

2013-10-30 14:18:19,979 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000000 Task Transitioned from NEW to SCHEDULED

2013-10-30 14:18:19,979 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn01 to /default-rack

2013-10-30 14:18:19,979 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn05 to /default-rack

2013-10-30 14:18:19,979 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn09 to /default-rack

.

.

..

2013-10-30 14:18:20,032 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000175 Task Transitioned from NEW to SCHEDULED

2013-10-30 14:18:20,032 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn10 to /default-rack

2013-10-30 14:18:20,032 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn02 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn09 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000176 Task Transitioned from NEW to SCHEDULED

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn10 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn04 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn03 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000177 Task Transitioned from NEW to SCHEDULED

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn03 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn05 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn09 to /default-rack

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000178 Task Transitioned from NEW to SCHEDULED

2013-10-30 14:18:20,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_r_000000 Task Transitioned from NEW to SCHEDULED

.

.

..

2013-10-30 14:18:20,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_r_000037 Task Transitioned from NEW to SCHEDULED

2013-10-30 14:18:20,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_r_000038 Task Transitioned from NEW to SCHEDULED

2013-10-30 14:18:20,052 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000000_0 TaskAttempt Transitioned from NEW to
UNASSIGNED

2013-10-30 14:18:20,052 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000001_0 TaskAttempt Transitioned from NEW to
UNASSIGNED

.

.

.

to UNASSIGNED

2013-10-30 14:18:20,071 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_r_000037_0 TaskAttempt Transitioned from NEW to
UNASSIGNED

2013-10-30 14:18:20,071 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_r_000038_0 TaskAttempt Transitioned from NEW to
UNASSIGNED

2013-10-30 14:18:20,072 INFO [Thread-48]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
mapResourceReqt:1536

2013-10-30 14:18:20,101 INFO [Thread-48]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
reduceResourceReqt:1024

2013-10-30 14:18:20,873 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:39 ScheduledMaps:179 ScheduledReds:0 AssignedMaps:0
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0
HostLocal:0 RackLocal:0

2013-10-30 14:18:20,892 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
for application_1383065659051_0002: ask=12 release= 0 newContainers=0
finishedContainers=0 resourcelimit=<memory:79872, vCores:0> knownNMs=10

2013-10-30 14:18:20,892 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
schedule, headroom=79872

2013-10-30 14:18:20,892 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
start threshold not met. completedMapsForReduceSlowstart 9

2013-10-30 14:18:21,907 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated
containers 39

2013-10-30 14:18:21,908 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_1383065659051_0002_01_000002 to
attempt_1383065659051_0002_m_000005_0

2013-10-30 14:18:21,909 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_1383065659051_0002_01_000003 to
attempt_1383065659051_0002_m_000006_0

2013-10-30 14:18:21,909 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_1383065659051_0002_01_000004 to
attempt_1383065659051_0002_m_000007_0

.

.

.

2013-10-30 14:18:21,914 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_1383065659051_0002_01_000039 to
attempt_1383065659051_0002_m_000033_0

2013-10-30 14:18:21,915 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_1383065659051_0002_01_000040 to
attempt_1383065659051_0002_m_000039_0

2013-10-30 14:18:21,915 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating
schedule, headroom=0

2013-10-30 14:18:21,915 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow
start threshold not met. completedMapsForReduceSlowstart 9

2013-10-30 14:18:21,915 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:39 ScheduledMaps:140 ScheduledReds:0 AssignedMaps:39
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:39 ContRel:0
HostLocal:39 RackLocal:0

2013-10-30 14:18:21,922 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn07 to /default-rack

2013-10-30 14:18:21,931 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar
file on the remote FS is
hdfs://10.40.3.56:9000/tmp/hadoop-yarn/staging/root/.staging/job_13830656590
51_0002/job.jar

2013-10-30 14:18:21,933 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf
file on the remote FS is
/tmp/hadoop-yarn/staging/root/.staging/job_1383065659051_0002/job.xml

2013-10-30 14:18:21,934 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0
tokens and #1 secret keys for NM use for launching container

2013-10-30 14:18:21,934 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
containertokens_dob is 1

2013-10-30 14:18:21,934 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle
token in serviceData

2013-10-30 14:18:21,947 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000005_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED

2013-10-30 14:18:21,948 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn07 to /default-rack

2013-10-30 14:18:21,948 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000006_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED

.

.

.

2013-10-30 14:18:21,965 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000033_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED

2013-10-30 14:18:21,965 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn05 to /default-rack

2013-10-30 14:18:21,965 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000039_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED

2013-10-30 14:18:21,966 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000002 taskAttempt
attempt_1383065659051_0002_m_000005_0

2013-10-30 14:18:21,967 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000004 taskAttempt
attempt_1383065659051_0002_m_000007_0

2013-10-30 14:18:21,967 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000003 taskAttempt
attempt_1383065659051_0002_m_000006_0

2013-10-30 14:18:21,968 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000005 taskAttempt
attempt_1383065659051_0002_m_000008_0

2013-10-30 14:18:21,968 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000006 taskAttempt
attempt_1383065659051_0002_m_000002_0

2013-10-30 14:18:21,971 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000008 taskAttempt
attempt_1383065659051_0002_m_000004_0

2013-10-30 14:18:21,971 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000007 taskAttempt
attempt_1383065659051_0002_m_000003_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000004_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000009 taskAttempt
attempt_1383065659051_0002_m_000010_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000010_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #6]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn04:59153

2013-10-30 14:18:21,972 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000008_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000007_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000006_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000002_0

2013-10-30 14:18:21,972 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000005_0

2013-10-30 14:18:21,973 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000011 taskAttempt
attempt_1383065659051_0002_m_000017_0

2013-10-30 14:18:21,973 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000017_0

2013-10-30 14:18:21,973 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000010 taskAttempt
attempt_1383065659051_0002_m_000001_0

2013-10-30 14:18:21,973 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000001_0

2013-10-30 14:18:21,973 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000003_0

2013-10-30 14:18:21,987 INFO [ContainerLauncher #8]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn01:44782

2013-10-30 14:18:21,987 INFO [ContainerLauncher #0]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn07:46075

2013-10-30 14:18:22,012 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000001_0
: 13562

2013-10-30 14:18:22,012 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000002_0
: 13562

2013-10-30 14:18:22,012 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000008_0
: 13562

2013-10-30 14:18:22,012 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000012 taskAttempt
attempt_1383065659051_0002_m_000018_0

2013-10-30 14:18:22,012 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000014 taskAttempt
attempt_1383065659051_0002_m_000000_0

2013-10-30 14:18:22,012 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000018_0

2013-10-30 14:18:22,012 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000013 taskAttempt
attempt_1383065659051_0002_m_000019_0

2013-10-30 14:18:22,012 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000000_0

2013-10-30 14:18:22,012 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000019_0

2013-10-30 14:18:22,012 INFO [ContainerLauncher #4]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn08:38653

2013-10-30 14:18:22,013 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000002_0] using containerId:
[container_1383065659051_0002_01_000006 on NM: [saturn04:59153]

2013-10-30 14:18:22,013 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000017_0
: 13562

2013-10-30 14:18:22,013 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000015 taskAttempt
attempt_1383065659051_0002_m_000009_0

2013-10-30 14:18:22,013 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000009_0

2013-10-30 14:18:22,014 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000018_0
: 13562

2013-10-30 14:18:22,014 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000016 taskAttempt
attempt_1383065659051_0002_m_000013_0

2013-10-30 14:18:22,014 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000013_0

2013-10-30 14:18:22,014 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000002_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,014 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000008_0] using containerId:
[container_1383065659051_0002_01_000005 on NM: [saturn07:46075]

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000008_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000001_0] using containerId:
[container_1383065659051_0002_01_000010 on NM: [saturn01:44782]

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000001_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000017_0] using containerId:
[container_1383065659051_0002_01_000011 on NM: [saturn01:44782]

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000017_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000002

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000018_0] using containerId:
[container_1383065659051_0002_01_000012 on NM: [saturn01:44782]

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000018_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,015 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000002 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000008

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000008 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000001

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000001 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000017

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000017 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000018

2013-10-30 14:18:22,016 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000018 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,022 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000000_0
: 13562

2013-10-30 14:18:22,022 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000017 taskAttempt
attempt_1383065659051_0002_m_000014_0

2013-10-30 14:18:22,022 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000014_0

2013-10-30 14:18:22,022 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000000_0] using containerId:
[container_1383065659051_0002_01_000014 on NM: [saturn08:38653]

2013-10-30 14:18:22,023 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000000_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,023 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000000

2013-10-30 14:18:22,023 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000000 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,023 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000009_0
: 13562

2013-10-30 14:18:22,023 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000018 taskAttempt
attempt_1383065659051_0002_m_000012_0

2013-10-30 14:18:22,023 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000012_0

2013-10-30 14:18:22,023 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000009_0] using containerId:
[container_1383065659051_0002_01_000015 on NM: [saturn08:38653]

2013-10-30 14:18:22,023 INFO [ContainerLauncher #9]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn10:52050

2013-10-30 14:18:22,024 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000009_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,024 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000009

2013-10-30 14:18:22,024 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000009 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,024 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000013_0
: 13562

2013-10-30 14:18:22,024 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000019 taskAttempt
attempt_1383065659051_0002_m_000015_0

2013-10-30 14:18:22,024 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000015_0

2013-10-30 14:18:22,026 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000013_0] using containerId:
[container_1383065659051_0002_01_000016 on NM: [saturn08:38653]

2013-10-30 14:18:22,026 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000013_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,026 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000013

2013-10-30 14:18:22,026 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000013 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,032 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000015_0
: 13562

2013-10-30 14:18:22,032 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000020 taskAttempt
attempt_1383065659051_0002_m_000016_0

2013-10-30 14:18:22,032 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000016_0

2013-10-30 14:18:22,032 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000015_0] using containerId:
[container_1383065659051_0002_01_000019 on NM: [saturn10:52050]

2013-10-30 14:18:22,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000015_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000015

2013-10-30 14:18:22,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000015 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,033 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000012_0
: 13562

2013-10-30 14:18:22,033 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000021 taskAttempt
attempt_1383065659051_0002_m_000020_0

2013-10-30 14:18:22,033 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000020_0

2013-10-30 14:18:22,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000012_0] using containerId:
[container_1383065659051_0002_01_000018 on NM: [saturn10:52050]

2013-10-30 14:18:22,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000012_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000012

2013-10-30 14:18:22,034 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000012 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,034 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000016_0
: 13562

2013-10-30 14:18:22,034 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000022 taskAttempt
attempt_1383065659051_0002_m_000021_0

2013-10-30 14:18:22,034 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000021_0

2013-10-30 14:18:22,034 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000016_0] using containerId:
[container_1383065659051_0002_01_000020 on NM: [saturn10:52050]

2013-10-30 14:18:22,034 INFO [ContainerLauncher #8]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn03:57282

2013-10-30 14:18:22,034 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000016_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,034 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000016

2013-10-30 14:18:22,034 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000016 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,035 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000020_0
: 13562

2013-10-30 14:18:22,035 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000023 taskAttempt
attempt_1383065659051_0002_m_000023_0

2013-10-30 14:18:22,035 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000023_0

2013-10-30 14:18:22,035 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000020_0] using containerId:
[container_1383065659051_0002_01_000021 on NM: [saturn10:52050]

2013-10-30 14:18:22,035 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000020_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,035 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000020

2013-10-30 14:18:22,035 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000020 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,041 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000021_0
: 13562

2013-10-30 14:18:22,041 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000024 taskAttempt
attempt_1383065659051_0002_m_000025_0

2013-10-30 14:18:22,041 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000025_0

2013-10-30 14:18:22,041 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000021_0] using containerId:
[container_1383065659051_0002_01_000022 on NM: [saturn03:57282]

2013-10-30 14:18:22,041 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000021_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,042 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000021

2013-10-30 14:18:22,042 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000021 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,042 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000023_0
: 13562

2013-10-30 14:18:22,042 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000025 taskAttempt
attempt_1383065659051_0002_m_000026_0

2013-10-30 14:18:22,042 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000026_0

2013-10-30 14:18:22,042 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000023_0] using containerId:
[container_1383065659051_0002_01_000023 on NM: [saturn03:57282]

2013-10-30 14:18:22,042 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000023_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,042 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000023

2013-10-30 14:18:22,042 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000023 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,043 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000025_0
: 13562

2013-10-30 14:18:22,043 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000026 taskAttempt
attempt_1383065659051_0002_m_000024_0

2013-10-30 14:18:22,043 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000024_0

2013-10-30 14:18:22,043 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000025_0] using containerId:
[container_1383065659051_0002_01_000024 on NM: [saturn03:57282]

2013-10-30 14:18:22,043 INFO [ContainerLauncher #8]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn06:54945

2013-10-30 14:18:22,043 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000025_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,043 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000025

2013-10-30 14:18:22,043 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000025 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,048 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000003_0
: 13562

2013-10-30 14:18:22,048 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000010_0
: 13562

2013-10-30 14:18:22,048 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000004_0
: 13562

2013-10-30 14:18:22,048 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000027 taskAttempt
attempt_1383065659051_0002_m_000030_0

2013-10-30 14:18:22,048 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000028 taskAttempt
attempt_1383065659051_0002_m_000031_0

2013-10-30 14:18:22,048 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000029 taskAttempt
attempt_1383065659051_0002_m_000036_0

2013-10-30 14:18:22,048 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000030_0

2013-10-30 14:18:22,049 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000036_0

2013-10-30 14:18:22,049 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000031_0

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000003_0] using containerId:
[container_1383065659051_0002_01_000007 on NM: [saturn04:59153]

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000003_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000010_0] using containerId:
[container_1383065659051_0002_01_000009 on NM: [saturn04:59153]

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000010_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000004_0] using containerId:
[container_1383065659051_0002_01_000008 on NM: [saturn04:59153]

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000004_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000003

2013-10-30 14:18:22,049 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000005_0
: 13562

2013-10-30 14:18:22,049 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000003 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,049 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000030 taskAttempt
attempt_1383065659051_0002_m_000011_0

2013-10-30 14:18:22,049 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000011_0

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000010

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000010 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000004

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000004 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000005_0] using containerId:
[container_1383065659051_0002_01_000002 on NM: [saturn07:46075]

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000005_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000005

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000005 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,049 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000006_0
: 13562

2013-10-30 14:18:22,050 INFO [ContainerLauncher #0]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn09:33738

2013-10-30 14:18:22,049 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000007_0
: 13562

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000006_0] using containerId:
[container_1383065659051_0002_01_000003 on NM: [saturn07:46075]

2013-10-30 14:18:22,050 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000006_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000007_0] using containerId:
[container_1383065659051_0002_01_000004 on NM: [saturn07:46075]

2013-10-30 14:18:22,051 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000031 taskAttempt
attempt_1383065659051_0002_m_000028_0

2013-10-30 14:18:22,051 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000032 taskAttempt
attempt_1383065659051_0002_m_000042_0

2013-10-30 14:18:22,051 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000028_0

2013-10-30 14:18:22,051 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000042_0

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000007_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000006

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000006 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,051 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000024_0
: 13562

2013-10-30 14:18:22,051 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000033 taskAttempt
attempt_1383065659051_0002_m_000047_0

2013-10-30 14:18:22,051 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000047_0

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000007

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000007 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000024_0] using containerId:
[container_1383065659051_0002_01_000026 on NM: [saturn06:54945]

2013-10-30 14:18:22,051 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000024_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,052 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000024

2013-10-30 14:18:22,052 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000024 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,054 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000019_0
: 13562

2013-10-30 14:18:22,054 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000034 taskAttempt
attempt_1383065659051_0002_m_000029_0

2013-10-30 14:18:22,054 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000029_0

2013-10-30 14:18:22,054 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000019_0] using containerId:
[container_1383065659051_0002_01_000013 on NM: [saturn01:44782]

2013-10-30 14:18:22,054 INFO [ContainerLauncher #3]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn02:53544

2013-10-30 14:18:22,055 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000019_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,055 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000019

2013-10-30 14:18:22,055 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000019 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,058 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000047_0
: 13562

2013-10-30 14:18:22,058 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000035 taskAttempt
attempt_1383065659051_0002_m_000032_0

2013-10-30 14:18:22,058 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000032_0

2013-10-30 14:18:22,058 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000047_0] using containerId:
[container_1383065659051_0002_01_000033 on NM: [saturn09:33738]

2013-10-30 14:18:22,058 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000047_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,058 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000047

2013-10-30 14:18:22,058 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000047 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,062 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000032_0
: 13562

2013-10-30 14:18:22,062 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000036 taskAttempt
attempt_1383065659051_0002_m_000034_0

2013-10-30 14:18:22,062 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000034_0

2013-10-30 14:18:22,062 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000032_0] using containerId:
[container_1383065659051_0002_01_000035 on NM: [saturn02:53544]

2013-10-30 14:18:22,062 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000032_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,063 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000032

2013-10-30 14:18:22,063 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000032 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,063 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000029_0
: 13562

2013-10-30 14:18:22,063 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000037 taskAttempt
attempt_1383065659051_0002_m_000038_0

2013-10-30 14:18:22,063 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000038_0

2013-10-30 14:18:22,063 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000029_0] using containerId:
[container_1383065659051_0002_01_000034 on NM: [saturn02:53544]

2013-10-30 14:18:22,063 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000029_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,063 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000029

2013-10-30 14:18:22,063 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000014_0
: 13562

2013-10-30 14:18:22,063 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000029 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,064 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000038 taskAttempt
attempt_1383065659051_0002_m_000022_0

2013-10-30 14:18:22,064 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000022_0

2013-10-30 14:18:22,064 INFO [ContainerLauncher #4]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : saturn05:37959

2013-10-30 14:18:22,064 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000014_0] using containerId:
[container_1383065659051_0002_01_000017 on NM: [saturn08:38653]

2013-10-30 14:18:22,064 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000014_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,064 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000014

2013-10-30 14:18:22,064 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000014 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,064 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000034_0
: 13562

2013-10-30 14:18:22,064 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000039 taskAttempt
attempt_1383065659051_0002_m_000033_0

2013-10-30 14:18:22,064 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000033_0

2013-10-30 14:18:22,064 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000034_0] using containerId:
[container_1383065659051_0002_01_000036 on NM: [saturn02:53544]

2013-10-30 14:18:22,065 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000034_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,065 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000038_0
: 13562

2013-10-30 14:18:22,065 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000034

2013-10-30 14:18:22,065 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_1383065659051_0002_01_000040 taskAttempt
attempt_1383065659051_0002_m_000039_0

2013-10-30 14:18:22,065 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000034 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,065 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching
attempt_1383065659051_0002_m_000039_0

2013-10-30 14:18:22,065 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000038_0] using containerId:
[container_1383065659051_0002_01_000037 on NM: [saturn02:53544]

2013-10-30 14:18:22,065 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000038_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,065 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000038

2013-10-30 14:18:22,066 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000038 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,069 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000033_0
: 13562

2013-10-30 14:18:22,069 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000033_0] using containerId:
[container_1383065659051_0002_01_000039 on NM: [saturn05:37959]

2013-10-30 14:18:22,069 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000033_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,069 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000033

2013-10-30 14:18:22,069 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000033 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,070 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000039_0
: 13562

2013-10-30 14:18:22,070 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000039_0] using containerId:
[container_1383065659051_0002_01_000040 on NM: [saturn05:37959]

2013-10-30 14:18:22,070 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000039_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,070 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000039

2013-10-30 14:18:22,070 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000039 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,083 INFO [ContainerLauncher #9]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000026_0
: 13562

2013-10-30 14:18:22,084 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000026_0] using containerId:
[container_1383065659051_0002_01_000025 on NM: [saturn03:57282]

2013-10-30 14:18:22,084 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000026_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,084 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000026

2013-10-30 14:18:22,084 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000026 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,091 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000031_0
: 13562

2013-10-30 14:18:22,092 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000030_0
: 13562

2013-10-30 14:18:22,092 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000036_0
: 13562

2013-10-30 14:18:22,092 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000031_0] using containerId:
[container_1383065659051_0002_01_000028 on NM: [saturn06:54945]

2013-10-30 14:18:22,092 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000031_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,092 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000030_0] using containerId:
[container_1383065659051_0002_01_000027 on NM: [saturn06:54945]

2013-10-30 14:18:22,092 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000030_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,092 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000036_0] using containerId:
[container_1383065659051_0002_01_000029 on NM: [saturn06:54945]

2013-10-30 14:18:22,092 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000036_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,092 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000031

2013-10-30 14:18:22,093 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000031 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,093 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000030

2013-10-30 14:18:22,093 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000030 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,093 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000036

2013-10-30 14:18:22,093 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000036 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,099 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000028_0
: 13562

2013-10-30 14:18:22,099 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000042_0
: 13562

2013-10-30 14:18:22,099 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000011_0
: 13562

2013-10-30 14:18:22,099 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000028_0] using containerId:
[container_1383065659051_0002_01_000031 on NM: [saturn09:33738]

2013-10-30 14:18:22,099 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000028_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,099 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000042_0] using containerId:
[container_1383065659051_0002_01_000032 on NM: [saturn09:33738]

2013-10-30 14:18:22,099 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000042_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,099 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000011_0] using containerId:
[container_1383065659051_0002_01_000030 on NM: [saturn09:33738]

2013-10-30 14:18:22,100 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000011_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,100 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000028

2013-10-30 14:18:22,100 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000028 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,100 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000042

2013-10-30 14:18:22,100 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000042 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,100 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000011

2013-10-30 14:18:22,100 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000011 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,109 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle
port returned by ContainerManager for attempt_1383065659051_0002_m_000022_0
: 13562

2013-10-30 14:18:22,110 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1383065659051_0002_m_000022_0] using containerId:
[container_1383065659051_0002_01_000038 on NM: [saturn05:37959]

2013-10-30 14:18:22,110 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000022_0 TaskAttempt Transitioned from ASSIGNED
to RUNNING

2013-10-30 14:18:22,110 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator:
ATTEMPT_START task_1383065659051_0002_m_000022

2013-10-30 14:18:22,110 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000022 Task Transitioned from SCHEDULED to RUNNING

2013-10-30 14:18:22,918 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources()
for application_1383065659051_0002: ask=12 release= 0 newContainers=0
finishedContainers=0 resourcelimit=<memory:0, vCores:-39> knownNMs=10

2013-10-30 14:18:23,203 INFO [Socket Reader #1 for port 44262]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1383065659051_0002 (auth:SIMPLE)

2013-10-30 14:18:23,281 INFO [IPC Server handler 0 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1383065659051_0002_m_000038 asked for a task

2013-10-30 14:18:23,281 INFO [IPC Server handler 0 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1383065659051_0002_m_000038 given task:
attempt_1383065659051_0002_m_000022_0

2013-10-30 14:18:23,347 INFO [Socket Reader #1 for port 44262]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1383065659051_0002 (auth:SIMPLE)

2013-10-30 14:18:23,355 INFO [Socket Reader #1 for port 44262]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1383065659051_0002 (auth:SIMPLE)

2013-10-30 14:18:23,361 INFO [IPC Server handler 1 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1383065659051_0002_m_000039 asked for a task

2013-10-30 14:18:23,361 INFO [IPC Server handler 1 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1383065659051_0002_m_000039 given task:
attempt_1383065659051_0002_m_000033_0

.

.

.

2013-10-30 14:18:23,934 INFO [IPC Server handler 5 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1383065659051_0002_m_000036 asked for a task

2013-10-30 14:18:23,934 INFO [IPC Server handler 5 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1383065659051_0002_m_000036 given task:
attempt_1383065659051_0002_m_000034_0

2013-10-30 14:18:23,939 INFO [Socket Reader #1 for port 44262]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1383065659051_0002 (auth:SIMPLE)

2013-10-30 14:18:23,945 INFO [Socket Reader #1 for port 44262]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1383065659051_0002 (auth:SIMPLE)

2013-10-30 14:18:23,966 INFO [IPC Server handler 7 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1383065659051_0002_m_000018 asked for a task

2013-10-30 14:18:23,966 INFO [IPC Server handler 7 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1383065659051_0002_m_000018 given task:
attempt_1383065659051_0002_m_000012_0

2013-10-30 14:18:23,979 INFO [IPC Server handler 8 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1383065659051_0002_m_000037 asked for a task

2013-10-30 14:18:23,979 INFO [IPC Server handler 8 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1383065659051_0002_m_000037 given task:
attempt_1383065659051_0002_m_000038_0

2013-10-30 14:18:24,437 FATAL [IPC Server handler 9 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1383065659051_0002_m_000022_0 - exited : Java heap space

2013-10-30 14:18:24,438 INFO [IPC Server handler 9 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from
attempt_1383065659051_0002_m_000022_0: Error: Java heap space

2013-10-30 14:18:24,439 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics
report from attempt_1383065659051_0002_m_000022_0: Error: Java heap space

2013-10-30 14:18:24,441 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000022_0 TaskAttempt Transitioned from RUNNING
to FAIL_CONTAINER_CLEANUP

2013-10-30 14:18:24,441 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
container_1383065659051_0002_01_000038 taskAttempt
attempt_1383065659051_0002_m_000022_0

2013-10-30 14:18:24,441 INFO [ContainerLauncher #8]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING
attempt_1383065659051_0002_m_000022_0

2013-10-30 14:18:24,446 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000022_0 TaskAttempt Transitioned from
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP

2013-10-30 14:18:24,447 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:24,450 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000022_0

2013-10-30 14:18:24,451 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000022_0 TaskAttempt Transitioned from
FAIL_TASK_CLEANUP to FAILED

2013-10-30 14:18:24,455 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn10 to /default-rack

2013-10-30 14:18:24,455 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn01 to /default-rack

2013-10-30 14:18:24,455 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved saturn05 to /default-rack

2013-10-30 14:18:24,457 INFO [Thread-48]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on
node saturn05

 

..

..

..

..

..

2013-10-30 14:18:36,321 INFO [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,321 INFO [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,321 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,322 WARN [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000010_3

2013-10-30 14:18:36,323 WARN [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000006_2

2013-10-30 14:18:36,323 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,323 INFO [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,323 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000010_3 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,323 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000006_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,323 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000010 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,323 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000006 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,324 INFO [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,324 INFO [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,324 WARN [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000009_3

2013-10-30 14:18:36,324 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,325 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000009_3 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,325 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000009 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,325 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000008_2

2013-10-30 14:18:36,325 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,326 WARN [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000029_2

2013-10-30 14:18:36,326 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,326 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000008_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,326 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000029_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,326 WARN [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000018_2

2013-10-30 14:18:36,326 INFO [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,326 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000008 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,326 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000029 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,326 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000018_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,326 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000018 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,326 WARN [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000022_3

2013-10-30 14:18:36,326 INFO [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,327 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000022_3 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,327 WARN [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000027_2

2013-10-30 14:18:36,327 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000022 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,327 INFO [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,327 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000027_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,327 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000027 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,327 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000033_3

2013-10-30 14:18:36,327 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,327 WARN [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000035_2

2013-10-30 14:18:36,327 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,328 WARN [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000040_2

2013-10-30 14:18:36,328 INFO [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,328 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000033_3 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,328 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000044_2

2013-10-30 14:18:36,328 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,328 WARN [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000043_2

2013-10-30 14:18:36,328 INFO [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,328 WARN [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000042_2

2013-10-30 14:18:36,329 INFO [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,329 INFO [Socket Reader #1 for port 44262]
org.apache.hadoop.ipc.Server: IPC Server listener on 44262: readAndProcess
from client 10.40.3.84 threw exception [java.io.IOException: Connection
reset by peer]

java.io.IOException: Connection reset by peer

        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)

        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:218)

        at sun.nio.ch.IOUtil.read(IOUtil.java:191)

        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)

        at org.apache.hadoop.ipc.Server.channelRead(Server.java:2597)

        at org.apache.hadoop.ipc.Server.access$3200(Server.java:122)

        at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1500)

        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:792)

        at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:591)

        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:566)

2013-10-30 14:18:36,329 WARN [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000049_2

2013-10-30 14:18:36,330 INFO [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,329 WARN [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000046_2

2013-10-30 14:18:36,330 INFO [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,330 INFO [Socket Reader #1 for port 44262]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1383065659051_0002 (auth:SIMPLE)

2013-10-30 14:18:36,329 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000051_2

2013-10-30 14:18:36,330 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,329 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000035_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,329 WARN [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000037_2

2013-10-30 14:18:36,331 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,331 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000040_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,331 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000033 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,331 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000044_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,331 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000043_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,331 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000013_2 TaskAttempt Transitioned from
KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP

2013-10-30 14:18:36,331 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000042_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,331 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000035 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000049_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000046_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000051_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000037_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000040 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000044 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000043 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000042 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000049 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000046 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000051 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,332 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000037 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,334 WARN [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000045_2

2013-10-30 14:18:36,334 WARN [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000036_2

2013-10-30 14:18:36,334 INFO [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,334 INFO [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000045_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,335 WARN [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000048_2

2013-10-30 14:18:36,335 INFO [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000036_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000045 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000048_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000036 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000048 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,335 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000050_2

2013-10-30 14:18:36,335 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: TASK_ABORT

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000050_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,335 WARN [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000055_2

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000050 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000055_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,335 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000055 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,335 WARN [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000047_2

2013-10-30 14:18:36,336 WARN [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000054_2

2013-10-30 14:18:36,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000047_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000054_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000047 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,336 WARN [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000052_2

2013-10-30 14:18:36,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000054 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000052_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000052 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,346 INFO [IPC Server handler 27 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1383065659051_0002_m_000159 asked for a task

2013-10-30 14:18:36,346 INFO [IPC Server handler 27 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1383065659051_0002_m_000159 is invalid and will be killed.

2013-10-30 14:18:36,369 FATAL [IPC Server handler 28 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1383065659051_0002_m_000029_2 - exited : Java heap space

2013-10-30 14:18:36,369 INFO [IPC Server handler 28 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from
attempt_1383065659051_0002_m_000029_2: Error: Java heap space

2013-10-30 14:18:36,369 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics
report from attempt_1383065659051_0002_m_000029_2: Error: Java heap space

2013-10-30 14:18:36,376 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete
hdfs://10.40.3.56:9000/user/root/twitter_output1/_temporary/1/_temporary/att
empt_1383065659051_0002_m_000013_2

2013-10-30 14:18:36,376 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1383065659051_0002_m_000013_2 TaskAttempt Transitioned from
KILL_TASK_CLEANUP to KILLED

2013-10-30 14:18:36,377 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1383065659051_0002_m_000013 Task Transitioned from KILL_WAIT to KILLED

2013-10-30 14:18:36,377 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1383065659051_0002Job Transitioned from FAIL_WAIT to FAIL_ABORT

2013-10-30 14:18:36,377 INFO [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
the event EventType: JOB_ABORT

2013-10-30 14:18:36,399 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1383065659051_0002Job Transitioned from FAIL_ABORT to FAILED

2013-10-30 14:18:36,399 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so
this is the last retry

2013-10-30 14:18:36,399 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
isAMLastRetry: true

2013-10-30 14:18:36,399 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
notified that shouldUnregistered is: true

2013-10-30 14:18:36,399 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry:
true

2013-10-30 14:18:36,399 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
JobHistoryEventHandler notified that forceJobCompletion is true

2013-10-30 14:18:36,399 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the
services

2013-10-30 14:18:36,400 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping
JobHistoryEventHandler. Size of the outstanding queue size is 14

2013-10-30 14:18:36,400 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event TASK_FAILED

2013-10-30 14:18:36,401 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event MAP_ATTEMPT_KILLED

2013-10-30 14:18:36,402 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event TASK_FAILED

2013-10-30 14:18:36,403 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event MAP_ATTEMPT_KILLED

2013-10-30 14:18:36,404 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event TASK_FAILED

2013-10-30 14:18:36,405 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event MAP_ATTEMPT_KILLED

2013-10-30 14:18:36,406 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event MAP_ATTEMPT_KILLED

2013-10-30 14:18:36,407 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event TASK_FAILED

2013-10-30 14:18:36,408 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event TASK_FAILED

2013-10-30 14:18:36,409 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event MAP_ATTEMPT_KILLED

2013-10-30 14:18:36,410 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event TASK_FAILED

2013-10-30 14:18:36,411 INFO [IPC Server handler 29 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from
attempt_1383065659051_0002_m_000047_2

2013-10-30 14:18:36,411 INFO [IPC Server handler 29 on 44262]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt
attempt_1383065659051_0002_m_000047_2 is : 0.0

2013-10-30 14:18:36,411 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event MAP_ATTEMPT_KILLED

2013-10-30 14:18:36,412 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event TASK_FAILED

2013-10-30 14:18:36,413 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
writing event JOB_FAILED

2013-10-30 14:18:36,468 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://10.40.3.56:9000/tmp/hadoop-yarn/staging/root/.staging/job_13830656590
51_0002/job_1383065659051_0002_1.jhist to
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002-1383110296900-root-hash%2Dto%2Dmin+%5Btwitter_input%5D-13831103162
52-0-0-FAILED-default.jhist_tmp

2013-10-30 14:18:36,505 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to
done location:
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002-1383110296900-root-hash%2Dto%2Dmin+%5Btwitter_input%5D-13831103162
52-0-0-FAILED-default.jhist_tmp

2013-10-30 14:18:36,514 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://10.40.3.56:9000/tmp/hadoop-yarn/staging/root/.staging/job_13830656590
51_0002/job_1383065659051_0002_1_conf.xml to
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002_conf.xml_tmp

2013-10-30 14:18:36,539 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to
done location:
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002_conf.xml_tmp

2013-10-30 14:18:36,556 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
done:
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002.summary_tmp to
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002.summary

2013-10-30 14:18:36,572 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
done:
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002_conf.xml_tmp to
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002_conf.xml

2013-10-30 14:18:36,580 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
done:
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002-1383110296900-root-hash%2Dto%2Dmin+%5Btwitter_input%5D-13831103162
52-0-0-FAILED-default.jhist_tmp to
hdfs://10.40.3.56:9000/home/hadoop/hadoop2-mr-history/tmp/root/job_138306565
9051_0002-1383110296900-root-hash%2Dto%2Dmin+%5Btwitter_input%5D-13831103162
52-0-0-FAILED-default.jhist

2013-10-30 14:18:36,580 INFO [Thread-68]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
JobHistoryEventHandler. super.stop()

2013-10-30 14:18:36,582 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job
diagnostics to Task failed task_1383065659051_0002_m_000039

Job failed as tasks failed. failedMaps:1 failedReduces:0

 

2013-10-30 14:18:36,582 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is
http://saturn05:19888/jobhistory/job/job_1383065659051_0002

2013-10-30 14:18:36,586 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for
application to be successfully unregistered.

2013-10-30 14:18:37,588 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats:
PendingReds:39 ScheduledMaps:148 ScheduledReds:0 AssignedMaps:38
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:171 ContRel:2
HostLocal:55 RackLocal:0

2013-10-30 14:18:37,588 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory
hdfs://10.40.3.56:9000
/tmp/hadoop-yarn/staging/root/.staging/job_1383065659051_0002

2013-10-30 14:18:37,606 INFO [Thread-68] org.apache.hadoop.ipc.Server:
Stopping server on 44262

2013-10-30 14:18:37,606 INFO [IPC Server listener on 44262]
org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 44262

2013-10-30 14:18:37,606 INFO [TaskHeartbeatHandler PingChecker]
org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
TaskHeartbeatHandler thread interrupted

2013-10-30 14:18:37,607 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: Stopping IPC Server Responder

2013-10-30 14:18:42,607 INFO [Thread-68] org.apache.hadoop.ipc.Server:
Stopping server on 47129

2013-10-30 14:18:42,607 INFO [IPC Server listener on 47129]
org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 47129

2013-10-30 14:18:42,607 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: Stopping IPC Server Responder

2013-10-30 14:18:42,608 INFO [Thread-68] org.mortbay.log: Stopped
SelectChannelConnector@0.0.0.0:0

2013-10-30 14:18:42,709 INFO [Thread-68]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Exiting MR
AppMaster..GoodBye!

2013-10-30 14:18:42,709 INFO [Thread-1]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a
signal. Signaling RMCommunicator and JobHistoryEventHandler.

2013-10-30 14:18:42,709 INFO [Thread-1]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
notified that iSignalled is: true

2013-10-30 14:18:42,709 INFO [Thread-1]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
isAMLastRetry: true

2013-10-30 14:18:42,709 INFO [Thread-1]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
notified that shouldUnregistered is: true

2013-10-30 14:18:42,709 INFO [Thread-1]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry:
true

2013-10-30 14:18:42,709 INFO [Thread-1]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
JobHistoryEventHandler notified that forceJobCompletion is true

 

Therefore, at first I thought that if I allocated more RAM to my container
could solve this problem.

So, I changed mapreduce.map.java.opt / mapreduce.reduce.java.opt /
mapreduce.map.memory.mb / mapreduce.reduce.memory.mb to somewhat higher than
before

But same errors are occurred.

 

I also knew that yarn.nodemanager.vmem-pmem-ratio option but I thought it
doesn't matter.

 

Please give me some hint or clue for this problem.

 

Thanks!

 

 

 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message