Return-Path: X-Original-To: apmail-incubator-giraph-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-giraph-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 917F09321 for ; Wed, 28 Mar 2012 08:13:10 +0000 (UTC) Received: (qmail 13770 invoked by uid 500); 28 Mar 2012 08:13:10 -0000 Delivered-To: apmail-incubator-giraph-dev-archive@incubator.apache.org Received: (qmail 13606 invoked by uid 500); 28 Mar 2012 08:13:06 -0000 Mailing-List: contact giraph-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: giraph-dev@incubator.apache.org Delivered-To: mailing list giraph-dev@incubator.apache.org Received: (qmail 13571 invoked by uid 99); 28 Mar 2012 08:13:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Mar 2012 08:13:05 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Mar 2012 08:12:56 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 4EE7E34AFBB for ; Wed, 28 Mar 2012 08:12:34 +0000 (UTC) Date: Wed, 28 Mar 2012 08:12:34 +0000 (UTC) From: "Jianfeng Qian (Commented) (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: <179536380.27685.1332922354352.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1826334767.11748.1332549325801.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (GIRAPH-169) How to close all child when a job finished? MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GIRAPH-169?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1324= 0285#comment-13240285 ]=20 Jianfeng Qian commented on GIRAPH-169: -------------------------------------- hadoop 0.20.205.0. most of the time, the worker can't quit. sorry, there is the full worker log 2012-03-28 10:18:00,122 WARN org.apache.hadoop.util.NativeCodeLoader: Unabl= e to load native-hadoop library for your platform... using builtin-java cla= sses where applicable 2012-03-28 10:18:00,387 WARN org.apache.giraph.bsp.BspOutputFormat: getOutp= utCommitter: Returning ImmutableOutputCommiter (does nothing). 2012-03-28 10:18:00,397 INFO org.apache.hadoop.util.ProcessTree: setsid exi= ted with exit code 0 2012-03-28 10:18:00,405 INFO org.apache.hadoop.mapred.Task: Using Resource= CalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@183= 30bf 2012-03-28 10:18:00,489 INFO org.apache.giraph.graph.GraphMapper: Distribut= ed cache is empty. Assuming fatjar. 2012-03-28 10:18:00,489 INFO org.apache.giraph.graph.GraphMapper: setup: cl= asspath @ /usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTrac= ker/root/jobcache/job_201203281017_0001/jars/job.jar 2012-03-28 10:18:00,498 INFO org.apache.giraph.zk.ZooKeeperManager: createC= andidateStamp: Made the directory _bsp/_defaultZkManagerDir/job_20120328101= 7_0001 2012-03-28 10:18:00,500 INFO org.apache.giraph.zk.ZooKeeperManager: createC= andidateStamp: Creating my filestamp _bsp/_defaultZkManagerDir/job_20120328= 1017_0001/_task/tmm-e6 1 2012-03-28 10:18:00,521 INFO org.apache.giraph.zk.ZooKeeperManager: getZooK= eeperServerList: For task 1, got file 'zkServerList_tmm-e10 0 ' (polling pe= riod is 3000) 2012-03-28 10:18:00,521 INFO org.apache.giraph.zk.ZooKeeperManager: getZooK= eeperServerList: Found [tmm-e10, 0] 2 hosts in filename 'zkServerList_tmm-e= 10 0 ' 2012-03-28 10:18:00,524 INFO org.apache.giraph.zk.ZooKeeperManager: onlineZ= ooKeeperServers: Got [tmm-e10] 1 hosts from 1 ready servers when 1 required= (polling period is 3000) on attempt 0 2012-03-28 10:18:00,524 INFO org.apache.giraph.graph.GraphMapper: setup: St= arting up BspServiceWorker... 2012-03-28 10:18:00,534 INFO org.apache.giraph.graph.BspService: BspService= : Connecting to ZooKeeper with job job_201203281017_0001, 1 on tmm-e10:2218= 1 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:zookeeper.version=3D3.3.3-1073969, built on 02/23/2011 22:27 GMT 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:host.name=3Dtmm-e6 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:java.version=3D1.6.0_22 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:java.vendor=3DSun Microsystems Inc. 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:java.home=3D/usr/local/java/jdk1.6.0_22/jre 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:java.class.path=3D/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/l= ocal/taskTracker/root/jobcache/job_201203281017_0001/jars/classes:/usr/loca= l/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/j= ob_201203281017_0001/jars:/usr/local/test-0302/hadoop-data/h-0.20.205/mapre= d/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_20120328101= 7_0001_m_000001_0/work:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../co= nf:/usr/local/java/jdk1.6.0_22/lib/tools.jar:/usr/local/test-0302/hadoop-0.= 20.205.0/libexec/../share/hadoop:/usr/local/test-0302/hadoop-0.20.205.0/lib= exec/../share/hadoop/hadoop-core-0.20.205.0.jar:/usr/local/test-0302/hadoop= -0.20.205.0/libexec/../share/hadoop/lib/asm-3.2.jar:/usr/local/test-0302/ha= doop-0.20.205.0/libexec/../share/hadoop/lib/aspectjrt-1.6.5.jar:/usr/local/= test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/aspectjtools-1.6.5.= jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/comm= ons-beanutils-1.7.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../s= hare/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/local/test-0302/hadoo= p-0.20.205.0/libexec/../share/hadoop/lib/commons-cli-1.2.jar:/usr/local/tes= t-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-codec-1.4.jar:= /usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-= collections-3.2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../sha= re/hadoop/lib/commons-configuration-1.6.jar:/usr/local/test-0302/hadoop-0.2= 0.205.0/libexec/../share/hadoop/lib/commons-daemon-1.0.1.jar:/usr/local/tes= t-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-digester-1.8.j= ar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commo= ns-el-1.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoo= p/lib/commons-httpclient-3.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/l= ibexec/../share/hadoop/lib/commons-lang-2.4.jar:/usr/local/test-0302/hadoop= -0.20.205.0/libexec/../share/hadoop/lib/commons-logging-1.1.1.jar:/usr/loca= l/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-logging-a= pi-1.0.4.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop= /lib/commons-math-2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/..= /share/hadoop/lib/commons-net-1.4.1.jar:/usr/local/test-0302/hadoop-0.20.20= 5.0/libexec/../share/hadoop/lib/core-3.1.1.jar:/usr/local/test-0302/hadoop-= 0.20.205.0/libexec/../share/hadoop/lib/hadoop-capacity-scheduler-0.20.205.0= .jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/had= oop-fairscheduler-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/lib= exec/../share/hadoop/lib/hadoop-thriftfs-0.20.205.0.jar:/usr/local/test-030= 2/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lo= cal/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jackson-core-as= l-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/= lib/jackson-mapper-asl-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/lib= exec/../share/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/local/test-0302/ha= doop-0.20.205.0/libexec/../share/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/= local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jdeb-0.8.jar:= /usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jersey-c= ore-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/= lib/jersey-json-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../s= hare/hadoop/lib/jersey-server-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.= 0/libexec/../share/hadoop/lib/jets3t-0.6.1.jar:/usr/local/test-0302/hadoop-= 0.20.205.0/libexec/../share/hadoop/lib/jetty-6.1.26.jar:/usr/local/test-030= 2/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jetty-util-6.1.26.jar:/usr/= local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jsch-0.1.42.j= ar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/junit= -4.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib= /kfs-0.2.2.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hado= op/lib/log4j-1.2.15.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../s= hare/hadoop/lib/mockito-all-1.8.5.jar:/usr/local/test-0302/hadoop-0.20.205.= 0/libexec/../share/hadoop/lib/oro-2.0.8.jar:/usr/local/test-0302/hadoop-0.2= 0.205.0/libexec/../share/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/local= /test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/slf4j-api-1.4.3.ja= r:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/slf4j-= log4j12-1.4.3.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/h= adoop/lib/xmlenc-0.52.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/..= /share/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/local/test-0302/hadoop-0.20.205.= 0/libexec/../share/hadoop/lib/jsp-2.1/jsp-api-2.1.jar 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:java.library.path=3D/usr/local/test-0302/hadoop-0.20.205.0/libexec/../= lib:/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/ro= ot/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:java.io.tmpdir=3D/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/lo= cal/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_00= 01_m_000001_0/work/tmp 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:java.compiler=3D 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:os.name=3DLinux 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:os.arch=3Damd64 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:os.version=3D2.6.32.12-0.7-default 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:user.name=3Droot 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:user.home=3D/root 2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client environ= ment:user.dir=3D/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/ta= skTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_0= 00001_0/work 2012-03-28 10:18:00,541 INFO org.apache.zookeeper.ZooKeeper: Initiating cli= ent connection, connectString=3Dtmm-e10:22181 sessionTimeout=3D60000 watche= r=3Dorg.apache.giraph.graph.BspServiceWorker@4cdada24 2012-03-28 10:18:00,552 INFO org.apache.zookeeper.ClientCnxn: Opening socke= t connection to server tmm-e10/2.1.1.130:22181 2012-03-28 10:18:00,552 INFO org.apache.zookeeper.ClientCnxn: Socket connec= tion established to tmm-e10/2.1.1.130:22181, initiating session 2012-03-28 10:18:01,045 INFO org.apache.zookeeper.ClientCnxn: Session estab= lishment complete on server tmm-e10/2.1.1.130:22181, sessionid =3D 0x136572= 0ee4e0001, negotiated timeout =3D 300000 2012-03-28 10:18:01,046 INFO org.apache.giraph.graph.BspService: process: A= synchronous connection complete. 2012-03-28 10:18:01,370 INFO org.apache.giraph.comm.RPCCommunications: getR= PCServer: Added jobToken Ident: 15 6a 6f 62 5f 32 30 31 32 30 33 32 38 31 3= 0 31 37 5f 30 30 30 31, Pass: 19 3a 73 94 ac b2 04 7e fb 06 a6 18 d8 3a 54 = 11 e2 15 42 64, Kind: mapreduce.job, Service: job_201203281017_0001 2012-03-28 10:18:01,375 INFO org.apache.hadoop.ipc.Server: Starting SocketR= eader 2012-03-28 10:18:01,380 INFO org.apache.hadoop.ipc.Server: IPC Server Respo= nder: starting 2012-03-28 10:18:01,380 INFO org.apache.hadoop.ipc.Server: IPC Server liste= ner on 30001: starting 2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 0 on 30001: starting 2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 1 on 30001: starting 2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 2 on 30001: starting 2012-03-28 10:18:01,382 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 3 on 30001: starting .......................... 2012-03-28 10:18:01,388 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 64 on 30001: starting 2012-03-28 10:18:01,388 INFO org.apache.giraph.comm.BasicRPCCommunications:= BasicRPCCommunications: Started RPC communication server: tmm-e6/2.1.1.126= :30001 with 65 handlers and 63 flush threads on bind attempt 0 2012-03-28 10:18:01,388 INFO org.apache.giraph.graph.GraphMapper: setup: Re= gistering health of this worker... 2012-03-28 10:18:01,408 INFO org.apache.giraph.graph.BspService: getJobStat= e: Job state already exists (/_hadoopBsp/job_201203281017_0001/_masterJobSt= ate) 2012-03-28 10:18:01,421 INFO org.apache.giraph.graph.BspService: getApplica= tionAttempt: Node /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir= already exists! 2012-03-28 10:18:01,427 INFO org.apache.giraph.graph.BspService: getApplica= tionAttempt: Node /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir= already exists! 2012-03-28 10:18:01,494 INFO org.apache.giraph.graph.BspServiceWorker: regi= sterHealth: Created my health node for attempt=3D0, superstep=3D-1 with /_h= adoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/-1/_= workerHealthyDir/tmm-e6_1 and workerInfo=3D Worker(hostname=3Dtmm-e6, MRpar= tition=3D1, port=3D30001) 2012-03-28 10:18:21,970 INFO org.apache.giraph.graph.BspService: process: p= artitionAssignmentsReadyChanged (partitions are assigned) 2012-03-28 10:18:22,093 INFO org.apache.giraph.graph.BspServiceWorker: star= tSuperstep: Ready for computation on superstep -1 since worker selection an= d vertex range assignments are done in /_hadoopBsp/job_201203281017_0001/_a= pplicationAttemptsDir/0/_superstepDir/-1/_partitionAssignments 2012-03-28 10:18:22,637 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/34/_inputSplitReserved 2012-03-28 10:18:22,709 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/39/_inputSplitReserved 2012-03-28 10:18:22,783 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/37/_inputSplitReserved 2012-03-28 10:18:22,818 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/38/_inputSplitReserved 2012-03-28 10:18:22,896 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/43/_inputSplitReserved 2012-03-28 10:18:22,957 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/42/_inputSplitReserved 2012-03-28 10:18:22,980 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/41/_inputSplitReserved 2012-03-28 10:18:23,053 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/40/_inputSplitReserved 2012-03-28 10:18:23,083 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/22/_inputSplitReserved 2012-03-28 10:18:23,165 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/23/_inputSplitReserved 2012-03-28 10:18:23,233 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Couldn't reserve (already reserved) inputSplit at /_hadoopBs= p/job_201203281017_0001/_inputSplitDir/24/_inputSplitReserved 2012-03-28 10:18:23,340 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Reserved input split path /_hadoopBsp/job_201203281017_0001/= _inputSplitDir/25, overall roughly 0.0% input splits finished 2012-03-28 10:18:23,357 INFO org.apache.giraph.graph.BspServiceWorker: getI= nputSplitForVertices: Reserved /_hadoopBsp/job_201203281017_0001/_inputSpli= tDir/25 from ZooKeeper and got input split ''org.apache.giraph.bsp.BspInput= Split, index=3D25, num=3D64' 2012-03-28 10:18:23,914 INFO org.apache.giraph.graph.BspServiceWorker: load= VerticesFromInputSplit: Finished loading /_hadoopBsp/job_201203281017_0001/= _inputSplitDir/25 (v=3D15625, e=3D250000) 2012-03-28 10:18:25,192 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: Reserved input split path /_hadoopBsp/job_201203281017_0001/= _inputSplitDir/50, overall roughly 34.375% input splits finished 2012-03-28 10:18:25,198 INFO org.apache.giraph.graph.BspServiceWorker: getI= nputSplitForVertices: Reserved /_hadoopBsp/job_201203281017_0001/_inputSpli= tDir/50 from ZooKeeper and got input split ''org.apache.giraph.bsp.BspInput= Split, index=3D50, num=3D64' 2012-03-28 10:18:25,402 INFO org.apache.giraph.graph.BspServiceWorker: load= VerticesFromInputSplit: Finished loading /_hadoopBsp/job_201203281017_0001/= _inputSplitDir/50 (v=3D15625, e=3D250000) 2012-03-28 10:18:25,623 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: reservedPath =3D null, 62 of 64 InputSplits are finished. 2012-03-28 10:18:25,760 INFO org.apache.giraph.graph.BspServiceWorker: rese= rveInputSplit: reservedPath =3D null, 64 of 64 InputSplits are finished. 2012-03-28 10:18:32,009 INFO org.apache.giraph.graph.BspServiceWorker: setu= p: Finally loaded a total of (v=3D31250, e=3D500000) 2012-03-28 10:18:32,040 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsAllDoneChanged (all vertices sent from input splits) 2012-03-28 10:18:32,226 INFO org.apache.giraph.graph.BspServiceWorker: move= VerticesToWorker: Adding 334 vertices for partition id 1582 ....................................... 2012-03-28 10:18:32,236 INFO org.apache.giraph.graph.BspServiceWorker: move= VerticesToWorker: Adding 334 vertices for partition id 302 2012-03-28 10:18:32,236 INFO org.apache.giraph.graph.BspServiceWorker: move= VerticesToWorker: Adding 334 vertices for partition id 1454 2012-03-28 10:18:32,249 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: starting for superstep -1 totalMem =3D 301.125M, maxMem =3D 1777.81= 25M, freeMem =3D 139.03758M 2012-03-28 10:18:32,265 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: ended for superstep -1 totalMem =3D 301.125M, maxMem =3D 1777.8125M= , freeMem =3D 139.02933M 2012-03-28 10:18:32,266 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Superstep -1 totalMem =3D 301.125M, maxMem =3D 1777.8125M, fre= eMem =3D 139.02933M 2012-03-28 10:18:32,455 INFO org.apache.giraph.graph.BspService: process: s= uperstepFinished signaled 2012-03-28 10:18:32,458 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Completed superstep -1 with global stats (vtx=3D1000000,finVtx= =3D0,edges=3D16000000,msgCount=3D0) 2012-03-28 10:18:32,458 INFO org.apache.giraph.comm.BasicRPCCommunications:= prepareSuperstep: Superstep 0 totalMem =3D 301.125M, maxMem =3D 1777.8125M= , freeMem =3D 139.02928M 2012-03-28 10:18:32,649 WARN org.apache.giraph.graph.BspService: process: U= nknown and unprocessed event (path=3D/_hadoopBsp/job_201203281017_0001/_app= licationAttemptsDir/0/_superstepDir, type=3DNodeChildrenChanged, state=3DSy= ncConnected) 2012-03-28 10:18:32,742 INFO org.apache.giraph.graph.BspServiceWorker: regi= sterHealth: Created my health node for attempt=3D0, superstep=3D0 with /_ha= doopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_wo= rkerHealthyDir/tmm-e6_1 and workerInfo=3D Worker(hostname=3Dtmm-e6, MRparti= tion=3D1, port=3D30001) 2012-03-28 10:18:32,848 INFO org.apache.giraph.graph.BspService: process: p= artitionAssignmentsReadyChanged (partitions are assigned) 2012-03-28 10:18:32,916 INFO org.apache.giraph.graph.BspServiceWorker: star= tSuperstep: Ready for computation on superstep 0 since worker selection and= vertex range assignments are done in /_hadoopBsp/job_201203281017_0001/_ap= plicationAttemptsDir/0/_superstepDir/0/_partitionAssignments 2012-03-28 10:18:33,004 INFO org.apache.giraph.graph.BspServiceWorker: send= WorkerPartitions: Done sending all my partitions. 2012-03-28 10:18:33,010 INFO org.apache.giraph.graph.BspServiceWorker: exch= angeVertexPartitions: Done with exchange. 2012-03-28 10:18:34,115 INFO org.apache.giraph.graph.BspServiceWorker: stor= eCheckpoint: Finished metadata (_bsp/_checkpoints/job_201203281017_0001/0.t= mm-e6_1.metadata) and vertices (_bsp/_checkpoints/job_201203281017_0001/0.t= mm-e6_1.vertices). 2012-03-28 10:18:35,127 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: starting for superstep 0 totalMem =3D 448.125M, maxMem =3D 1777.812= 5M, freeMem =3D 293.0052M 2012-03-28 10:18:37,939 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: ended for superstep 0 totalMem =3D 449.75M, maxMem =3D 1777.8125M, = freeMem =3D 324.476M 2012-03-28 10:18:37,939 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Superstep 0 totalMem =3D 449.75M, maxMem =3D 1777.8125M, freeM= em =3D 324.476M 2012-03-28 10:18:38,350 INFO org.apache.giraph.graph.BspService: process: s= uperstepFinished signaled 2012-03-28 10:18:38,381 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Completed superstep 0 with global stats (vtx=3D1000000,finVtx= =3D0,edges=3D16000000,msgCount=3D748805328) 2012-03-28 10:18:38,382 INFO org.apache.giraph.comm.BasicRPCCommunications:= prepareSuperstep: Superstep 1 totalMem =3D 449.75M, maxMem =3D 1777.8125M,= freeMem =3D 318.8769M 2012-03-28 10:18:38,702 INFO org.apache.giraph.graph.BspServiceWorker: regi= sterHealth: Created my health node for attempt=3D0, superstep=3D1 with /_ha= doopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_wo= rkerHealthyDir/tmm-e6_1 and workerInfo=3D Worker(hostname=3Dtmm-e6, MRparti= tion=3D1, port=3D30001) 2012-03-28 10:18:39,026 INFO org.apache.giraph.graph.BspService: process: p= artitionAssignmentsReadyChanged (partitions are assigned) 2012-03-28 10:18:39,135 INFO org.apache.giraph.graph.BspServiceWorker: star= tSuperstep: Ready for computation on superstep 1 since worker selection and= vertex range assignments are done in /_hadoopBsp/job_201203281017_0001/_ap= plicationAttemptsDir/0/_superstepDir/1/_partitionAssignments 2012-03-28 10:18:39,152 INFO org.apache.giraph.graph.BspServiceWorker: getA= ggregatorValues: no aggregators in /_hadoopBsp/job_201203281017_0001/_appli= cationAttemptsDir/0/_superstepDir/0/_mergedAggregatorDir on superstep 1 2012-03-28 10:18:39,268 INFO org.apache.giraph.graph.BspServiceWorker: send= WorkerPartitions: Done sending all my partitions. 2012-03-28 10:18:39,324 INFO org.apache.giraph.graph.BspServiceWorker: exch= angeVertexPartitions: Done with exchange. 2012-03-28 10:18:40,042 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: starting for superstep 1 totalMem =3D 449.75M, maxMem =3D 1777.8125= M, freeMem =3D 205.70113M 2012-03-28 10:18:42,148 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: ended for superstep 1 totalMem =3D 683.1875M, maxMem =3D 1777.8125M= , freeMem =3D 430.8365M 2012-03-28 10:18:42,148 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Superstep 1 totalMem =3D 683.1875M, maxMem =3D 1777.8125M, fre= eMem =3D 430.8365M 2012-03-28 10:18:42,625 INFO org.apache.giraph.graph.BspService: process: s= uperstepFinished signaled 2012-03-28 10:18:42,681 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Completed superstep 1 with global stats (vtx=3D1000000,finVtx= =3D0,edges=3D16000000,msgCount=3D748805328) 2012-03-28 10:18:42,682 INFO org.apache.giraph.comm.BasicRPCCommunications:= prepareSuperstep: Superstep 2 totalMem =3D 683.1875M, maxMem =3D 1777.8125= M, freeMem =3D 424.08615M 2012-03-28 10:18:42,733 WARN org.apache.giraph.graph.BspService: process: U= nknown and unprocessed event (path=3D/_hadoopBsp/job_201203281017_0001/_app= licationAttemptsDir/0/_superstepDir/0/_partitionAssignments, type=3DNodeDel= eted, state=3DSyncConnected) 2012-03-28 10:18:42,882 INFO org.apache.giraph.graph.BspServiceWorker: regi= sterHealth: Created my health node for attempt=3D0, superstep=3D2 with /_ha= doopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_wo= rkerHealthyDir/tmm-e6_1 and workerInfo=3D Worker(hostname=3Dtmm-e6, MRparti= tion=3D1, port=3D30001) 2012-03-28 10:18:43,429 INFO org.apache.giraph.graph.BspServiceWorker: proc= essEvent : partitionExchangeChildrenChanged (at least one worker is done se= nding partitions) 2012-03-28 10:18:43,885 WARN org.apache.giraph.graph.BspService: process: U= nknown and unprocessed event (path=3D/_hadoopBsp/job_201203281017_0001/_app= licationAttemptsDir/0/_superstepDir/0/_superstepFinished, type=3DNodeDelete= d, state=3DSyncConnected) 2012-03-28 10:18:44,458 INFO org.apache.giraph.graph.BspService: process: p= artitionAssignmentsReadyChanged (partitions are assigned) 2012-03-28 10:18:44,527 INFO org.apache.giraph.graph.BspServiceWorker: star= tSuperstep: Ready for computation on superstep 2 since worker selection and= vertex range assignments are done in /_hadoopBsp/job_201203281017_0001/_ap= plicationAttemptsDir/0/_superstepDir/2/_partitionAssignments 2012-03-28 10:18:44,653 INFO org.apache.giraph.graph.BspServiceWorker: getA= ggregatorValues: no aggregators in /_hadoopBsp/job_201203281017_0001/_appli= cationAttemptsDir/0/_superstepDir/1/_mergedAggregatorDir on superstep 2 2012-03-28 10:18:44,778 INFO org.apache.giraph.graph.BspServiceWorker: send= WorkerPartitions: Done sending all my partitions. 2012-03-28 10:18:44,793 INFO org.apache.giraph.graph.BspServiceWorker: exch= angeVertexPartitions: Done with exchange. 2012-03-28 10:18:45,295 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: starting for superstep 2 totalMem =3D 683.1875M, maxMem =3D 1777.81= 25M, freeMem =3D 344.8612M 2012-03-28 10:18:47,269 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: ended for superstep 2 totalMem =3D 683.1875M, maxMem =3D 1777.8125M= , freeMem =3D 154.54968M 2012-03-28 10:18:47,433 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Superstep 2 totalMem =3D 683.1875M, maxMem =3D 1777.8125M, fre= eMem =3D 142.03284M 2012-03-28 10:18:47,955 INFO org.apache.giraph.graph.BspService: process: s= uperstepFinished signaled 2012-03-28 10:18:47,968 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Completed superstep 2 with global stats (vtx=3D1000000,finVtx= =3D0,edges=3D16000000,msgCount=3D748805328) 2012-03-28 10:18:47,969 INFO org.apache.giraph.comm.BasicRPCCommunications:= prepareSuperstep: Superstep 3 totalMem =3D 683.1875M, maxMem =3D 1777.8125= M, freeMem =3D 133.7648M 2012-03-28 10:18:47,988 WARN org.apache.giraph.graph.BspService: process: U= nknown and unprocessed event (path=3D/_hadoopBsp/job_201203281017_0001/_app= licationAttemptsDir/0/_superstepDir/1/_partitionAssignments, type=3DNodeDel= eted, state=3DSyncConnected)2012-03-28 10:18:48,327 INFO org.apache.giraph.= graph.BspServiceWorker: registerHealth: Created my health node for attempt= =3D0, superstep=3D3 with /_hadoopBsp/job_201203281017_0001/_applicationAtte= mptsDir/0/_superstepDir/3/_workerHealthyDir/tmm-e6_1 and workerInfo=3D Work= er(hostname=3Dtmm-e6, MRpartition=3D1, port=3D30001)2012-03-28 10:18:48,735= INFO org.apache.giraph.graph.BspServiceWorker: processEvent : partitionExc= hangeChildrenChanged (at least one worker is done sending partitions)2012-0= 3-28 10:18:49,186 WARN org.apache.giraph.graph.BspService: process: Unknown= and unprocessed event (path=3D/_hadoopBsp/job_201203281017_0001/_applicati= onAttemptsDir/0/_superstepDir/1/_superstepFinished, type=3DNodeDeleted, sta= te=3DSyncConnected) 2012-03-28 10:18:49,709 INFO org.apache.giraph.graph.BspService: process: p= artitionAssignmentsReadyChanged (partitions are assigned)2012-03-28 10:18:4= 9,766 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep: Ready = for computation on superstep 3 since worker selection and vertex range assi= gnments are done in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsD= ir/0/_superstepDir/3/_partitionAssignments2012-03-28 10:18:49,831 INFO org.= apache.giraph.graph.BspServiceWorker: getAggregatorValues: no aggregators i= n /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir= /2/_mergedAggregatorDir on superstep 3 2012-03-28 10:18:49,890 INFO org.apache.giraph.graph.BspServiceWorker: send= WorkerPartitions: Done sending all my partitions. 2012-03-28 10:18:49,927 INFO org.apache.giraph.graph.BspServiceWorker: exch= angeVertexPartitions: Done with exchange. 2012-03-28 10:18:49,937 INFO org.apache.giraph.graph.BspServiceWorker: proc= essEvent : partitionExchangeChildrenChanged (at least one worker is done se= nding partitions) 2012-03-28 10:18:50,701 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: starting for superstep 3 totalMem =3D 704.125M, maxMem =3D 1777.812= 5M, freeMem =3D 540.77454M2012-03-28 10:18:52,680 INFO org.apache.giraph.co= mm.BasicRPCCommunications: flush: ended for superstep 3 totalMem =3D 704.12= 5M, maxMem =3D 1777.8125M, freeMem =3D 326.51126M 2012-03-28 10:18:52,680 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Superstep 3 totalMem =3D 704.125M, maxMem =3D 1777.8125M, free= Mem =3D 326.51126M 2012-03-28 10:18:52,951 INFO org.apache.giraph.graph.BspService: process: s= uperstepFinished signaled2012-03-28 10:18:52,960 INFO org.apache.giraph.gra= ph.BspServiceWorker: finishSuperstep: Completed superstep 3 with global sta= ts (vtx=3D1000000,finVtx=3D0,edges=3D16000000,msgCount=3D748805328) 2012-03-28 10:18:52,960 INFO org.apache.giraph.comm.BasicRPCCommunications:= prepareSuperstep: Superstep 4 totalMem =3D 704.125M, maxMem =3D 1777.8125M= , freeMem =3D 325.5547M2012-03-28 10:18:52,997 WARN org.apache.giraph.graph= .BspService: process: Unknown and unprocessed event (path=3D/_hadoopBsp/job= _201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_partitionAssi= gnments, type=3DNodeDeleted, state=3DSyncConnected)2012-03-28 10:18:53,329 = INFO org.apache.giraph.graph.BspServiceWorker: registerHealth: Created my h= ealth node for attempt=3D0, superstep=3D4 with /_hadoopBsp/job_201203281017= _0001/_applicationAttemptsDir/0/_superstepDir/4/_workerHealthyDir/tmm-e6_1 = and workerInfo=3D Worker(hostname=3Dtmm-e6, MRpartition=3D1, port=3D30001) 2012-03-28 10:18:53,755 INFO org.apache.giraph.graph.BspServiceWorker: proc= essEvent : partitionExchangeChildrenChanged (at least one worker is done se= nding partitions)2012-03-28 10:18:54,245 WARN org.apache.giraph.graph.BspSe= rvice: process: Unknown and unprocessed event (path=3D/_hadoopBsp/job_20120= 3281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_superstepFinished, = type=3DNodeDeleted, state=3DSyncConnected) 2012-03-28 10:18:54,781 INFO org.apache.giraph.graph.BspService: process: p= artitionAssignmentsReadyChanged (partitions are assigned)2012-03-28 10:18:5= 4,833 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep: Ready = for computation on superstep 4 since worker selection and vertex range assi= gnments are done in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsD= ir/0/_superstepDir/4/_partitionAssignments2012-03-28 10:18:54,876 INFO org.= apache.giraph.graph.BspServiceWorker: getAggregatorValues: no aggregators i= n /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir= /3/_mergedAggregatorDir on superstep 42012-03-28 10:18:54,976 INFO org.apac= he.giraph.graph.BspServiceWorker: sendWorkerPartitions: Done sending all my= partitions. 2012-03-28 10:18:54,988 INFO org.apache.giraph.graph.BspServiceWorker: exch= angeVertexPartitions: Done with exchange. 2012-03-28 10:18:55,682 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: starting for superstep 4 totalMem =3D 704.125M, maxMem =3D 1777.812= 5M, freeMem =3D 232.67145M2012-03-28 10:18:57,644 INFO org.apache.giraph.co= mm.BasicRPCCommunications: flush: ended for superstep 4 totalMem =3D 768.56= 25M, maxMem =3D 1777.8125M, freeMem =3D 563.79004M 2012-03-28 10:18:57,645 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Superstep 4 totalMem =3D 768.5625M, maxMem =3D 1777.8125M, fre= eMem =3D 563.79004M 2012-03-28 10:18:57,994 INFO org.apache.giraph.graph.BspService: process: s= uperstepFinished signaled2012-03-28 10:18:58,004 INFO org.apache.giraph.gra= ph.BspServiceWorker: finishSuperstep: Completed superstep 4 with global sta= ts (vtx=3D1000000,finVtx=3D0,edges=3D16000000,msgCount=3D748805328) 2012-03-28 10:18:58,004 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Completed superstep 4 with global stats (vtx=3D1000000,finVtx= =3D0,edges=3D16000000,msgCount=3D748805328) 2012-03-28 10:18:58,004 INFO org.apache.giraph.comm.BasicRPCCommunications:= prepareSuperstep: Superstep 5 totalMem =3D 768.5625M, maxMem =3D 1777.8125= M, freeMem =3D 552.1009M2012-03-28 10:18:58,035 WARN org.apache.giraph.grap= h.BspService: process: Unknown and unprocessed event (path=3D/_hadoopBsp/jo= b_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_partitionAss= ignments, type=3DNodeDeleted, state=3DSyncConnected)2012-03-28 10:18:58,361= INFO org.apache.giraph.graph.BspServiceWorker: registerHealth: Created my = health node for attempt=3D0, superstep=3D5 with /_hadoopBsp/job_20120328101= 7_0001/_applicationAttemptsDir/0/_superstepDir/5/_workerHealthyDir/tmm-e6_1= and workerInfo=3D Worker(hostname=3Dtmm-e6, MRpartition=3D1, port=3D30001)= 2012-03-28 10:18:59,261 WARN org.apache.giraph.graph.BspService: process: U= nknown and unprocessed event (path=3D/_hadoopBsp/job_201203281017_0001/_app= licationAttemptsDir/0/_superstepDir/3/_superstepFinished, type=3DNodeDelete= d, state=3DSyncConnected) 2012-03-28 10:18:59,834 INFO org.apache.giraph.graph.BspService: process: p= artitionAssignmentsReadyChanged (partitions are assigned)2012-03-28 10:18:5= 9,881 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep: Ready = for computation on superstep 5 since worker selection and vertex range assi= gnments are done in /_hadoopBsp/job_201203281017_0001/_applicationAttemptsD= ir/0/_superstepDir/5/_partitionAssignments2012-03-28 10:18:59,979 INFO org.= apache.giraph.graph.BspServiceWorker: getAggregatorValues: no aggregators i= n /_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir= /4/_mergedAggregatorDir on superstep 5 2012-03-28 10:19:00,076 INFO org.apache.giraph.graph.BspServiceWorker: send= WorkerPartitions: Done sending all my partitions.2012-03-28 10:19:00,113 IN= FO org.apache.giraph.graph.BspServiceWorker: exchangeVertexPartitions: Done= with exchange. 2012-03-28 10:19:00,153 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: starting for superstep 5 totalMem =3D 768.5625M, maxMem =3D 1777.81= 25M, freeMem =3D 536.97296M 2012-03-28 10:19:00,154 INFO org.apache.giraph.comm.BasicRPCCommunications:= flush: ended for superstep 5 totalMem =3D 768.5625M, maxMem =3D 1777.8125M= , freeMem =3D 536.9681M2012-03-28 10:19:00,155 INFO org.apache.giraph.graph= .BspServiceWorker: finishSuperstep: Superstep 5 totalMem =3D 768.5625M, max= Mem =3D 1777.8125M, freeMem =3D 536.9675M 2012-03-28 10:19:00,270 INFO org.apache.giraph.graph.BspService: process: s= uperstepFinished signaled 2012-03-28 10:19:00,282 INFO org.apache.giraph.graph.BspServiceWorker: fini= shSuperstep: Completed superstep 5 with global stats (vtx=3D1000000,finVtx= =3D1000000,edges=3D16000000,msgCount=3D0)2012-03-28 10:19:00,282 INFO org.a= pache.giraph.graph.GraphMapper: map: BSP application done (global vertices = marked done) 2012-03-28 10:19:00,282 INFO org.apache.giraph.graph.GraphMapper: cleanup: = Starting for WORKER_ONLY2012-03-28 10:19:00,283 WARN org.apache.giraph.grap= h.BspServiceWorker: saveVertices: giraph.vertexOutputFormatClass not specif= ied -- there will be no saved output2012-03-28 10:19:00,329 WARN org.apache= .giraph.graph.BspService: process: Unknown and unprocessed event (path=3D/_= hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_= partitionAssignments, type=3DNodeDeleted, state=3DSyncConnected) 2012-03-28 10:19:00,534 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,535 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,537 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,538 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,538 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,539 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,539 INFO org.apache.giraph.graph.BspServiceWorker: clea= nup: Notifying master its okay to cleanup with /_hadoopBsp/job_201203281017= _0001/_cleanedUpDir/1_worker 2012-03-28 10:19:00,544 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,546 INFO org= .apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a r= eservation) 2012-03-28 10:19:00,547 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,548 INFO org= .apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a r= eservation) 2012-03-28 10:19:00,549 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,552 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,552 INFO org= .apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a r= eservation) 2012-03-28 10:19:00,556 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,558 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,559 INFO org= .apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a r= eservation) 2012-03-28 10:19:00,560 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,562 INFO org= .apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a r= eservation) 2012-03-28 10:19:00,563 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,564 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,564 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,576 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,577 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) 2012-03-28 10:19:00,578 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation) ............. 2012-03-28 10:19:00,583 INFO org.apache.giraph.graph.BspService: process: i= nputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,585 INFO org= .apache.zookeeper.ZooKeeper: Session: 0x1365720ee4e0001 closed 2012-03-28 10:19:00,585 INFO org.apache.zookeeper.ClientCnxn: EventThread s= hut down2012-03-28 10:19:00,585 INFO org.apache.giraph.comm.BasicRPCCommuni= cations: close: shutting down RPC server 2012-03-28 10:19:00,585 INFO org.apache.hadoop.ipc.Server: Stopping server = on 30001 2012-03-28 10:19:00,585 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 3 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 4 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 0 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 2 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 1 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 9 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 5 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 6 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 10 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 16 on 30001: exiting2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.S= erver: Stopping IPC Server listener on 30001 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 14 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 15 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 23 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 17 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 22 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 12 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 13 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.metrics.RpcInstrumentati= on: shut down 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: Stopping IPC Ser= ver Responder 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 32 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 11 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 27 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 31 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 29 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 21 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 37 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.giraph.zk.ZooKeeperManager: createZ= ooKeeperClosedStamp: Creating my filestamp _bsp/_defaultZkManagerDir/job_20= 1203281017_0001/_task/1.COMPUTATION_DONE 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 39 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 40 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 26 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 33 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 38 on 30001: exiting 2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 25 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 18 on 30001: exiting 2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 20 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 59 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 8 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 44 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 56 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 55 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 24 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 28 on 30001: exiting 2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handl= er 7 on 30001: exiting 2012-03-28 10:19:00,809 INFO org.apache.hadoop.mapred.Task: Task:attempt_20= 1203281017_0001_m_000001_0 is done. And is in the process of commiting 2012-03-28 10:19:00,863 INFO org.apache.hadoop.mapred.Task: Task 'attempt_2= 01203281017_0001_m_000001_0' done. 2012-03-28 10:19:00,868 INFO org.apache.hadoop.mapred.TaskLogsTruncater: In= itializing logs' truncater with mapRetainSize=3D-1 and reduceRetainSize=3D-= 1 =20 > How to close all child when a job finished? > ------------------------------------------- > > Key: GIRAPH-169 > URL: https://issues.apache.org/jira/browse/GIRAPH-169 > Project: Giraph > Issue Type: Improvement > Components: mapreduce > Affects Versions: 0.2.0 > Environment: sles 11 x64,jdk 1.6,hadoop 0.20.205.0,1 Master and 8= slaves, > Reporter: Jianfeng Qian > Priority: Minor > > I ran pagerank at hadoop 0.20.205.0. When the job finished,the child in s= laves didn't quit immediately and sometimes they never quit and I have to k= ill them.=20 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs: https://issues.apache.org/jira/secure/ContactAdministrators!default.jsp= a For more information on JIRA, see: http://www.atlassian.com/software/jira