incubator-giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jianfeng Qian (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-169) How to close all child when a job finished?
Date Wed, 28 Mar 2012 08:12:34 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240285#comment-13240285
] 

Jianfeng Qian commented on GIRAPH-169:
--------------------------------------

hadoop 0.20.205.0. most of the time, the worker can't quit.
sorry, there is the full worker log
2012-03-28 10:18:00,122 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2012-03-28 10:18:00,387 WARN org.apache.giraph.bsp.BspOutputFormat: getOutputCommitter: Returning
ImmutableOutputCommiter (does nothing).
2012-03-28 10:18:00,397 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code
0
2012-03-28 10:18:00,405 INFO org.apache.hadoop.mapred.Task:  Using ResourceCalculatorPlugin
: org.apache.hadoop.util.LinuxResourceCalculatorPlugin@18330bf
2012-03-28 10:18:00,489 INFO org.apache.giraph.graph.GraphMapper: Distributed cache is empty.
Assuming fatjar.
2012-03-28 10:18:00,489 INFO org.apache.giraph.graph.GraphMapper: setup: classpath @ /usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/jars/job.jar
2012-03-28 10:18:00,498 INFO org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp:
Made the directory _bsp/_defaultZkManagerDir/job_201203281017_0001
2012-03-28 10:18:00,500 INFO org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp:
Creating my filestamp _bsp/_defaultZkManagerDir/job_201203281017_0001/_task/tmm-e6 1
2012-03-28 10:18:00,521 INFO org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList:
For task 1, got file 'zkServerList_tmm-e10 0 ' (polling period is 3000)
2012-03-28 10:18:00,521 INFO org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList:
Found [tmm-e10, 0] 2 hosts in filename 'zkServerList_tmm-e10 0 '
2012-03-28 10:18:00,524 INFO org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers:
Got [tmm-e10] 1 hosts from 1 ready servers when 1 required (polling period is 3000) on attempt
0
2012-03-28 10:18:00,524 INFO org.apache.giraph.graph.GraphMapper: setup: Starting up BspServiceWorker...
2012-03-28 10:18:00,534 INFO org.apache.giraph.graph.BspService: BspService: Connecting to
ZooKeeper with job job_201203281017_0001, 1 on tmm-e10:22181
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.3-1073969,
built on 02/23/2011 22:27 GMT
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=tmm-e6
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Sun
Microsystems Inc.
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/local/java/jdk1.6.0_22/jre
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/jars/classes:/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/jars:/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../conf:/usr/local/java/jdk1.6.0_22/lib/tools.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/hadoop-core-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/asm-3.2.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/aspectjrt-1.6.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/aspectjtools-1.6.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-cli-1.2.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-codec-1.4.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-collections-3.2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-configuration-1.6.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-daemon-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-digester-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-el-1.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-lang-2.4.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-logging-1.1.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-math-2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-net-1.4.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/core-3.1.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hadoop-capacity-scheduler-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hadoop-fairscheduler-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hadoop-thriftfs-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jackson-core-asl-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jackson-mapper-asl-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jdeb-0.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jersey-core-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jersey-json-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jersey-server-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jets3t-0.6.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jetty-6.1.26.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jetty-util-6.1.26.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jsch-0.1.42.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/junit-4.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/kfs-0.2.2.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/log4j-1.2.15.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/mockito-all-1.8.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/oro-2.0.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/slf4j-api-1.4.3.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/xmlenc-0.52.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jsp-2.1/jsp-api-2.1.jar
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=/usr/local/test-0302/hadoop-0.20.205.0/libexec/../lib:/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work/tmp
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=2.6.32.12-0.7-default
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=root
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/root
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work
2012-03-28 10:18:00,541 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection,
connectString=tmm-e10:22181 sessionTimeout=60000 watcher=org.apache.giraph.graph.BspServiceWorker@4cdada24
2012-03-28 10:18:00,552 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to
server tmm-e10/2.1.1.130:22181
2012-03-28 10:18:00,552 INFO org.apache.zookeeper.ClientCnxn: Socket connection established
to tmm-e10/2.1.1.130:22181, initiating session
2012-03-28 10:18:01,045 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete
on server tmm-e10/2.1.1.130:22181, sessionid = 0x1365720ee4e0001, negotiated timeout = 300000
2012-03-28 10:18:01,046 INFO org.apache.giraph.graph.BspService: process: Asynchronous connection
complete.
2012-03-28 10:18:01,370 INFO org.apache.giraph.comm.RPCCommunications: getRPCServer: Added
jobToken Ident: 15 6a 6f 62 5f 32 30 31 32 30 33 32 38 31 30 31 37 5f 30 30 30 31, Pass: 19
3a 73 94 ac b2 04 7e fb 06 a6 18 d8 3a 54 11 e2 15 42 64, Kind: mapreduce.job, Service: job_201203281017_0001
2012-03-28 10:18:01,375 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
2012-03-28 10:18:01,380 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2012-03-28 10:18:01,380 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 30001: starting
2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 30001:
starting
2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 30001:
starting
2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 30001:
starting
2012-03-28 10:18:01,382 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 30001:
starting
..........................
2012-03-28 10:18:01,388 INFO org.apache.hadoop.ipc.Server: IPC Server handler 64 on 30001:
starting
2012-03-28 10:18:01,388 INFO org.apache.giraph.comm.BasicRPCCommunications: BasicRPCCommunications:
Started RPC communication server: tmm-e6/2.1.1.126:30001 with 65 handlers and 63 flush threads
on bind attempt 0
2012-03-28 10:18:01,388 INFO org.apache.giraph.graph.GraphMapper: setup: Registering health
of this worker...
2012-03-28 10:18:01,408 INFO org.apache.giraph.graph.BspService: getJobState: Job state already
exists (/_hadoopBsp/job_201203281017_0001/_masterJobState)
2012-03-28 10:18:01,421 INFO org.apache.giraph.graph.BspService: getApplicationAttempt: Node
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir already exists!
2012-03-28 10:18:01,427 INFO org.apache.giraph.graph.BspService: getApplicationAttempt: Node
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir already exists!
2012-03-28 10:18:01,494 INFO org.apache.giraph.graph.BspServiceWorker: registerHealth: Created
my health node for attempt=0, superstep=-1 with /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/-1/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:21,970 INFO org.apache.giraph.graph.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)
2012-03-28 10:18:22,093 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep: Ready
for computation on superstep -1 since worker selection and vertex range assignments are done
in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/-1/_partitionAssignments
2012-03-28 10:18:22,637 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/34/_inputSplitReserved
2012-03-28 10:18:22,709 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/39/_inputSplitReserved
2012-03-28 10:18:22,783 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/37/_inputSplitReserved
2012-03-28 10:18:22,818 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/38/_inputSplitReserved
2012-03-28 10:18:22,896 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/43/_inputSplitReserved
2012-03-28 10:18:22,957 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/42/_inputSplitReserved
2012-03-28 10:18:22,980 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/41/_inputSplitReserved
2012-03-28 10:18:23,053 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/40/_inputSplitReserved
2012-03-28 10:18:23,083 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/22/_inputSplitReserved
2012-03-28 10:18:23,165 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/23/_inputSplitReserved
2012-03-28 10:18:23,233 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Couldn't reserve (already reserved) inputSplit at /_hadoopBsp/job_201203281017_0001/_inputSplitDir/24/_inputSplitReserved
2012-03-28 10:18:23,340 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Reserved input split path /_hadoopBsp/job_201203281017_0001/_inputSplitDir/25, overall roughly
0.0% input splits finished
2012-03-28 10:18:23,357 INFO org.apache.giraph.graph.BspServiceWorker: getInputSplitForVertices:
Reserved /_hadoopBsp/job_201203281017_0001/_inputSplitDir/25 from ZooKeeper and got input
split ''org.apache.giraph.bsp.BspInputSplit, index=25, num=64'
2012-03-28 10:18:23,914 INFO org.apache.giraph.graph.BspServiceWorker: loadVerticesFromInputSplit:
Finished loading /_hadoopBsp/job_201203281017_0001/_inputSplitDir/25 (v=15625, e=250000)
2012-03-28 10:18:25,192 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
Reserved input split path /_hadoopBsp/job_201203281017_0001/_inputSplitDir/50, overall roughly
34.375% input splits finished
2012-03-28 10:18:25,198 INFO org.apache.giraph.graph.BspServiceWorker: getInputSplitForVertices:
Reserved /_hadoopBsp/job_201203281017_0001/_inputSplitDir/50 from ZooKeeper and got input
split ''org.apache.giraph.bsp.BspInputSplit, index=50, num=64'
2012-03-28 10:18:25,402 INFO org.apache.giraph.graph.BspServiceWorker: loadVerticesFromInputSplit:
Finished loading /_hadoopBsp/job_201203281017_0001/_inputSplitDir/50 (v=15625, e=250000)
2012-03-28 10:18:25,623 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
reservedPath = null, 62 of 64 InputSplits are finished.
2012-03-28 10:18:25,760 INFO org.apache.giraph.graph.BspServiceWorker: reserveInputSplit:
reservedPath = null, 64 of 64 InputSplits are finished.
2012-03-28 10:18:32,009 INFO org.apache.giraph.graph.BspServiceWorker: setup: Finally loaded
a total of (v=31250, e=500000)
2012-03-28 10:18:32,040 INFO org.apache.giraph.graph.BspService: process: inputSplitsAllDoneChanged
(all vertices sent from input splits)
2012-03-28 10:18:32,226 INFO org.apache.giraph.graph.BspServiceWorker: moveVerticesToWorker:
Adding 334 vertices for partition id 1582
.......................................
2012-03-28 10:18:32,236 INFO org.apache.giraph.graph.BspServiceWorker: moveVerticesToWorker:
Adding 334 vertices for partition id 302
2012-03-28 10:18:32,236 INFO org.apache.giraph.graph.BspServiceWorker: moveVerticesToWorker:
Adding 334 vertices for partition id 1454
2012-03-28 10:18:32,249 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: starting
for superstep -1 totalMem = 301.125M, maxMem = 1777.8125M, freeMem = 139.03758M
2012-03-28 10:18:32,265 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: ended for
superstep -1 totalMem = 301.125M, maxMem = 1777.8125M, freeMem = 139.02933M
2012-03-28 10:18:32,266 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep
-1 totalMem = 301.125M, maxMem = 1777.8125M, freeMem = 139.02933M
2012-03-28 10:18:32,455 INFO org.apache.giraph.graph.BspService: process: superstepFinished
signaled
2012-03-28 10:18:32,458 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed
superstep -1 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=0)
2012-03-28 10:18:32,458 INFO org.apache.giraph.comm.BasicRPCCommunications: prepareSuperstep:
Superstep 0 totalMem = 301.125M, maxMem = 1777.8125M, freeMem = 139.02928M
2012-03-28 10:18:32,649 WARN org.apache.giraph.graph.BspService: process: Unknown and unprocessed
event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir, type=NodeChildrenChanged,
state=SyncConnected)
2012-03-28 10:18:32,742 INFO org.apache.giraph.graph.BspServiceWorker: registerHealth: Created
my health node for attempt=0, superstep=0 with /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:32,848 INFO org.apache.giraph.graph.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)
2012-03-28 10:18:32,916 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep: Ready
for computation on superstep 0 since worker selection and vertex range assignments are done
in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_partitionAssignments
2012-03-28 10:18:33,004 INFO org.apache.giraph.graph.BspServiceWorker: sendWorkerPartitions:
Done sending all my partitions.
2012-03-28 10:18:33,010 INFO org.apache.giraph.graph.BspServiceWorker: exchangeVertexPartitions:
Done with exchange.
2012-03-28 10:18:34,115 INFO org.apache.giraph.graph.BspServiceWorker: storeCheckpoint: Finished
metadata (_bsp/_checkpoints/job_201203281017_0001/0.tmm-e6_1.metadata) and vertices (_bsp/_checkpoints/job_201203281017_0001/0.tmm-e6_1.vertices).
2012-03-28 10:18:35,127 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: starting
for superstep 0 totalMem = 448.125M, maxMem = 1777.8125M, freeMem = 293.0052M
2012-03-28 10:18:37,939 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: ended for
superstep 0 totalMem = 449.75M, maxMem = 1777.8125M, freeMem = 324.476M
2012-03-28 10:18:37,939 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep
0 totalMem = 449.75M, maxMem = 1777.8125M, freeMem = 324.476M
2012-03-28 10:18:38,350 INFO org.apache.giraph.graph.BspService: process: superstepFinished
signaled
2012-03-28 10:18:38,381 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed
superstep 0 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:38,382 INFO org.apache.giraph.comm.BasicRPCCommunications: prepareSuperstep:
Superstep 1 totalMem = 449.75M, maxMem = 1777.8125M, freeMem = 318.8769M
2012-03-28 10:18:38,702 INFO org.apache.giraph.graph.BspServiceWorker: registerHealth: Created
my health node for attempt=0, superstep=1 with /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:39,026 INFO org.apache.giraph.graph.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)
2012-03-28 10:18:39,135 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep: Ready
for computation on superstep 1 since worker selection and vertex range assignments are done
in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_partitionAssignments
2012-03-28 10:18:39,152 INFO org.apache.giraph.graph.BspServiceWorker: getAggregatorValues:
no aggregators in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_mergedAggregatorDir
on superstep 1
2012-03-28 10:18:39,268 INFO org.apache.giraph.graph.BspServiceWorker: sendWorkerPartitions:
Done sending all my partitions.
2012-03-28 10:18:39,324 INFO org.apache.giraph.graph.BspServiceWorker: exchangeVertexPartitions:
Done with exchange.
2012-03-28 10:18:40,042 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: starting
for superstep 1 totalMem = 449.75M, maxMem = 1777.8125M, freeMem = 205.70113M
2012-03-28 10:18:42,148 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: ended for
superstep 1 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem = 430.8365M
2012-03-28 10:18:42,148 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep
1 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem = 430.8365M
2012-03-28 10:18:42,625 INFO org.apache.giraph.graph.BspService: process: superstepFinished
signaled
2012-03-28 10:18:42,681 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed
superstep 1 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:42,682 INFO org.apache.giraph.comm.BasicRPCCommunications: prepareSuperstep:
Superstep 2 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem = 424.08615M
2012-03-28 10:18:42,733 WARN org.apache.giraph.graph.BspService: process: Unknown and unprocessed
event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:42,882 INFO org.apache.giraph.graph.BspServiceWorker: registerHealth: Created
my health node for attempt=0, superstep=2 with /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:43,429 INFO org.apache.giraph.graph.BspServiceWorker: processEvent : partitionExchangeChildrenChanged
(at least one worker is done sending partitions)
2012-03-28 10:18:43,885 WARN org.apache.giraph.graph.BspService: process: Unknown and unprocessed
event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:44,458 INFO org.apache.giraph.graph.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)
2012-03-28 10:18:44,527 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep: Ready
for computation on superstep 2 since worker selection and vertex range assignments are done
in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_partitionAssignments
2012-03-28 10:18:44,653 INFO org.apache.giraph.graph.BspServiceWorker: getAggregatorValues:
no aggregators in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_mergedAggregatorDir
on superstep 2
2012-03-28 10:18:44,778 INFO org.apache.giraph.graph.BspServiceWorker: sendWorkerPartitions:
Done sending all my partitions.
2012-03-28 10:18:44,793 INFO org.apache.giraph.graph.BspServiceWorker: exchangeVertexPartitions:
Done with exchange.
2012-03-28 10:18:45,295 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: starting
for superstep 2 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem = 344.8612M
2012-03-28 10:18:47,269 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: ended for
superstep 2 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem = 154.54968M
2012-03-28 10:18:47,433 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep
2 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem = 142.03284M
2012-03-28 10:18:47,955 INFO org.apache.giraph.graph.BspService: process: superstepFinished
signaled
2012-03-28 10:18:47,968 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed
superstep 2 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:47,969 INFO org.apache.giraph.comm.BasicRPCCommunications: prepareSuperstep:
Superstep 3 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem = 133.7648M
2012-03-28 10:18:47,988 WARN org.apache.giraph.graph.BspService: process: Unknown and unprocessed
event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)2012-03-28 10:18:48,327 INFO org.apache.giraph.graph.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=3 with /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)2012-03-28 10:18:48,735
INFO org.apache.giraph.graph.BspServiceWorker: processEvent : partitionExchangeChildrenChanged
(at least one worker is done sending partitions)2012-03-28 10:18:49,186 WARN org.apache.giraph.graph.BspService:
process: Unknown and unprocessed event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:49,709 INFO org.apache.giraph.graph.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)2012-03-28 10:18:49,766 INFO org.apache.giraph.graph.BspServiceWorker:
startSuperstep: Ready for computation on superstep 3 since worker selection and vertex range
assignments are done in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_partitionAssignments2012-03-28
10:18:49,831 INFO org.apache.giraph.graph.BspServiceWorker: getAggregatorValues: no aggregators
in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_mergedAggregatorDir
on superstep 3
2012-03-28 10:18:49,890 INFO org.apache.giraph.graph.BspServiceWorker: sendWorkerPartitions:
Done sending all my partitions.
2012-03-28 10:18:49,927 INFO org.apache.giraph.graph.BspServiceWorker: exchangeVertexPartitions:
Done with exchange.
2012-03-28 10:18:49,937 INFO org.apache.giraph.graph.BspServiceWorker: processEvent : partitionExchangeChildrenChanged
(at least one worker is done sending partitions)
2012-03-28 10:18:50,701 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: starting
for superstep 3 totalMem = 704.125M, maxMem = 1777.8125M, freeMem = 540.77454M2012-03-28 10:18:52,680
INFO org.apache.giraph.comm.BasicRPCCommunications: flush: ended for superstep 3 totalMem
= 704.125M, maxMem = 1777.8125M, freeMem = 326.51126M
2012-03-28 10:18:52,680 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep
3 totalMem = 704.125M, maxMem = 1777.8125M, freeMem = 326.51126M
2012-03-28 10:18:52,951 INFO org.apache.giraph.graph.BspService: process: superstepFinished
signaled2012-03-28 10:18:52,960 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep:
Completed superstep 3 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:52,960 INFO org.apache.giraph.comm.BasicRPCCommunications: prepareSuperstep:
Superstep 4 totalMem = 704.125M, maxMem = 1777.8125M, freeMem = 325.5547M2012-03-28 10:18:52,997
WARN org.apache.giraph.graph.BspService: process: Unknown and unprocessed event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)2012-03-28 10:18:53,329 INFO org.apache.giraph.graph.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=4 with /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:53,755 INFO org.apache.giraph.graph.BspServiceWorker: processEvent : partitionExchangeChildrenChanged
(at least one worker is done sending partitions)2012-03-28 10:18:54,245 WARN org.apache.giraph.graph.BspService:
process: Unknown and unprocessed event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:54,781 INFO org.apache.giraph.graph.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)2012-03-28 10:18:54,833 INFO org.apache.giraph.graph.BspServiceWorker:
startSuperstep: Ready for computation on superstep 4 since worker selection and vertex range
assignments are done in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_partitionAssignments2012-03-28
10:18:54,876 INFO org.apache.giraph.graph.BspServiceWorker: getAggregatorValues: no aggregators
in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_mergedAggregatorDir
on superstep 42012-03-28 10:18:54,976 INFO org.apache.giraph.graph.BspServiceWorker: sendWorkerPartitions:
Done sending all my partitions.
2012-03-28 10:18:54,988 INFO org.apache.giraph.graph.BspServiceWorker: exchangeVertexPartitions:
Done with exchange.
2012-03-28 10:18:55,682 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: starting
for superstep 4 totalMem = 704.125M, maxMem = 1777.8125M, freeMem = 232.67145M2012-03-28 10:18:57,644
INFO org.apache.giraph.comm.BasicRPCCommunications: flush: ended for superstep 4 totalMem
= 768.5625M, maxMem = 1777.8125M, freeMem = 563.79004M
2012-03-28 10:18:57,645 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep
4 totalMem = 768.5625M, maxMem = 1777.8125M, freeMem = 563.79004M
2012-03-28 10:18:57,994 INFO org.apache.giraph.graph.BspService: process: superstepFinished
signaled2012-03-28 10:18:58,004 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep:
Completed superstep 4 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:58,004 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed
superstep 4 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:58,004 INFO org.apache.giraph.comm.BasicRPCCommunications: prepareSuperstep:
Superstep 5 totalMem = 768.5625M, maxMem = 1777.8125M, freeMem = 552.1009M2012-03-28 10:18:58,035
WARN org.apache.giraph.graph.BspService: process: Unknown and unprocessed event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)2012-03-28 10:18:58,361 INFO org.apache.giraph.graph.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=5 with /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/5/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)2012-03-28 10:18:59,261
WARN org.apache.giraph.graph.BspService: process: Unknown and unprocessed event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:59,834 INFO org.apache.giraph.graph.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)2012-03-28 10:18:59,881 INFO org.apache.giraph.graph.BspServiceWorker:
startSuperstep: Ready for computation on superstep 5 since worker selection and vertex range
assignments are done in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/5/_partitionAssignments2012-03-28
10:18:59,979 INFO org.apache.giraph.graph.BspServiceWorker: getAggregatorValues: no aggregators
in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_mergedAggregatorDir
on superstep 5
2012-03-28 10:19:00,076 INFO org.apache.giraph.graph.BspServiceWorker: sendWorkerPartitions:
Done sending all my partitions.2012-03-28 10:19:00,113 INFO org.apache.giraph.graph.BspServiceWorker:
exchangeVertexPartitions: Done with exchange.
2012-03-28 10:19:00,153 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: starting
for superstep 5 totalMem = 768.5625M, maxMem = 1777.8125M, freeMem = 536.97296M
2012-03-28 10:19:00,154 INFO org.apache.giraph.comm.BasicRPCCommunications: flush: ended for
superstep 5 totalMem = 768.5625M, maxMem = 1777.8125M, freeMem = 536.9681M2012-03-28 10:19:00,155
INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep 5 totalMem = 768.5625M,
maxMem = 1777.8125M, freeMem = 536.9675M
2012-03-28 10:19:00,270 INFO org.apache.giraph.graph.BspService: process: superstepFinished
signaled
2012-03-28 10:19:00,282 INFO org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed
superstep 5 with global stats (vtx=1000000,finVtx=1000000,edges=16000000,msgCount=0)2012-03-28
10:19:00,282 INFO org.apache.giraph.graph.GraphMapper: map: BSP application done (global vertices
marked done)
2012-03-28 10:19:00,282 INFO org.apache.giraph.graph.GraphMapper: cleanup: Starting for WORKER_ONLY2012-03-28
10:19:00,283 WARN org.apache.giraph.graph.BspServiceWorker: saveVertices: giraph.vertexOutputFormatClass
not specified -- there will be no saved output2012-03-28 10:19:00,329 WARN org.apache.giraph.graph.BspService:
process: Unknown and unprocessed event (path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:19:00,534 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,535 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,537 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,538 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,538 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,539 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,539 INFO org.apache.giraph.graph.BspServiceWorker: cleanup: Notifying
master its okay to cleanup with /_hadoopBsp/job_201203281017_0001/_cleanedUpDir/1_worker
2012-03-28 10:19:00,544 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)2012-03-28 10:19:00,546 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,547 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)2012-03-28 10:19:00,548 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,549 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,552 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)2012-03-28 10:19:00,552 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,556 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,558 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)2012-03-28 10:19:00,559 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,560 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)2012-03-28 10:19:00,562 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,563 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,564 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,564 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,576 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,577 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
2012-03-28 10:19:00,578 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)
.............
2012-03-28 10:19:00,583 INFO org.apache.giraph.graph.BspService: process: inputSplitsStateChanged
(lost a reservation)2012-03-28 10:19:00,585 INFO org.apache.zookeeper.ZooKeeper: Session:
0x1365720ee4e0001 closed
2012-03-28 10:19:00,585 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down2012-03-28
10:19:00,585 INFO org.apache.giraph.comm.BasicRPCCommunications: close: shutting down RPC
server
2012-03-28 10:19:00,585 INFO org.apache.hadoop.ipc.Server: Stopping server on 30001
2012-03-28 10:19:00,585 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 10 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 16 on 30001:
exiting2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener
on 30001
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 14 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 15 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 23 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 17 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 22 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 12 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 13 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.metrics.RpcInstrumentation: shut down
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 32 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 11 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 27 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 31 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 29 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 21 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 37 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.giraph.zk.ZooKeeperManager: createZooKeeperClosedStamp:
Creating my filestamp _bsp/_defaultZkManagerDir/job_201203281017_0001/_task/1.COMPUTATION_DONE
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 39 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 40 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 26 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 33 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 38 on 30001:
exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler 25 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 30001:
exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 20 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 59 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 44 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 56 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 55 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 24 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 30001:
exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 30001:
exiting
2012-03-28 10:19:00,809 INFO org.apache.hadoop.mapred.Task: Task:attempt_201203281017_0001_m_000001_0
is done. And is in the process of commiting
2012-03-28 10:19:00,863 INFO org.apache.hadoop.mapred.Task: Task 'attempt_201203281017_0001_m_000001_0'
done.
2012-03-28 10:19:00,868 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
                
> How to close all child when a job finished?
> -------------------------------------------
>
>                 Key: GIRAPH-169
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-169
>             Project: Giraph
>          Issue Type: Improvement
>          Components: mapreduce
>    Affects Versions: 0.2.0
>         Environment: sles 11 x64,jdk 1.6,hadoop 0.20.205.0,1 Master and 8 slaves,
>            Reporter: Jianfeng Qian
>            Priority: Minor
>
> I ran pagerank at hadoop 0.20.205.0. When the job finished,the child in slaves didn't
quit immediately and sometimes they never quit and I have to kill them. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message