hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 牛兆捷 <nzjem...@gmail.com>
Subject ProcfsBasedProcessTree: Error
Date Wed, 08 May 2013 05:42:15 GMT
I find a warning from my container log like this below,
Anyone meet the problem?

2013-05-08 13:23:59,622 WARN [main]
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2013-05-08 13:23:59,732 INFO [main] org.apache.hadoop.util.Shell: setsid
exited with exit code 0
2013-05-08 13:23:59,824 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2013-05-08 13:23:59,909 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2013-05-08 13:23:59,909 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system
started
2013-05-08 13:23:59,933 INFO [main] org.apache.hadoop.mapred.YarnChild:
Executing with tokens:
2013-05-08 13:23:59,933 INFO [main] org.apache.hadoop.mapred.YarnChild:
Kind: mapreduce.job, Service: job_1367985414547_0009, Ident:
(org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@7ca522a6)
2013-05-08 13:24:00,009 INFO [main] org.apache.hadoop.mapred.YarnChild:
Sleeping for 0ms before retrying again. Got null now.
2013-05-08 13:24:01,263 INFO [main] org.apache.hadoop.mapred.YarnChild:
mapreduce.cluster.local.dir for child:
/data/hustnn/local/usercache/hustnn/appcache/application_1367985414547_0009
2013-05-08 13:24:01,480 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2013-05-08 13:24:01,576 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap
2013-05-08 13:24:01,612 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.tip.id is deprecated. Instead, use mapreduce.task.id
2013-05-08 13:24:01,613 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2013-05-08 13:24:01,613 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2013-05-08 13:24:01,694 WARN [main] org.apache.hadoop.conf.Configuration:
job.local.dir is deprecated. Instead, use mapreduce.job.local.dir
2013-05-08 13:24:01,694 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.job.id is deprecated. Instead, use mapreduce.job.id
2013-05-08 13:24:02,329 WARN [main] org.apache.hadoop.conf.Configuration:
session.id is deprecated. Instead, use dfs.metrics.session-id
2013-05-08 13:24:03,184 INFO [main] org.apache.hadoop.mapred.Task:  Using
ResourceCalculatorProcessTree : [ ]
2013-05-08 13:24:03,913 INFO [main] org.apache.hadoop.mapred.MapTask:
Processing split: hdfs://155.69.148.21:18000/terasort-23/part-m-00001 from
0 length 256000000
2013-05-08 13:24:03,928 INFO [main] org.apache.hadoop.mapred.MapTask: Map
output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask:
(EQUATOR) 0 kvi 134217724(536870896)
2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask:
mapreduce.task.io.sort.mb: 512
2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: soft
limit at 429496736
2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask:
bufstart = 0; bufvoid = 536870912
2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask:
kvstart = 134217724; length = 33554432
2013-05-08 13:25:10,643 INFO [main] org.apache.hadoop.mapred.MapTask:
Starting flush of map output
2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask:
Spilling map output
2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask:
bufstart = 0; bufend = 261120000; bufvoid = 536870912
2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask:
kvstart = 134217724(536870896); kvend = 123977728(495910912); length =
10239997/33554432
2013-05-08 13:25:42,934 INFO [main] org.apache.hadoop.mapred.MapTask:
Finished spill 0
2013-05-08 13:25:43,219 INFO [main] org.apache.hadoop.mapred.Task:
Task:attempt_1367985414547_0009_m_000001_0 is done. And is in the process
of committing
2013-05-08 13:26:35,311 WARN [main]
org.apache.hadoop.yarn.util.ProcfsBasedProcessTree: Error reading the
stream java.io.IOException: No such process
2013-05-08 13:26:35,319 INFO [main] org.apache.hadoop.mapred.Task: Task
'attempt_1367985414547_0009_m_000001_0' done.
2013-05-08 13:26:35,422 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask metrics
system...

-- 
*Sincerely,*
*Zhaojie*
*
*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message