Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4E1ECF200 for ; Tue, 6 Aug 2013 04:37:19 +0000 (UTC) Received: (qmail 65358 invoked by uid 500); 6 Aug 2013 04:37:17 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 65100 invoked by uid 500); 6 Aug 2013 04:37:15 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 65091 invoked by uid 99); 6 Aug 2013 04:37:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Aug 2013 04:37:13 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of xiangzeyuan90@gmail.com designates 209.85.212.176 as permitted sender) Received: from [209.85.212.176] (HELO mail-wi0-f176.google.com) (209.85.212.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Aug 2013 04:37:07 +0000 Received: by mail-wi0-f176.google.com with SMTP id f14so2210277wiw.3 for ; Mon, 05 Aug 2013 21:36:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:x-goomoji-body:date:message-id :subject:from:to:content-type; bh=UIdAwPEeL7qvoAeUhSfSgOKPf4XMriaI9ClNUKIFyHk=; b=sAnZ012D4D3z765xeXjybluKeicrZHuj2w3LJYtdXJ6TVjJosPzqwq3GlJzuyabf7E 4pMMGizswOTjfTYhnx6WsBPH3BjjVCcomgboeOnQCTYoM7OEFvSlsKa5mX4V6IQArGNE 8t53kMKKejNTT1MrC7wwR8LbsRyNtA9bb6fwpzHPGhhc6gRViOAK6U3M/Hm4yiWi197f t15XLRDKoaJFrVMsOc7SoSWv5pLCqf0Y4gtx32BrWKrSOKAykO88pZntRqf+fGcUeojE cJPnXYotWOcbbsVM66yaBfqTDYb5Poo9796irKugGFnGRU4D70pIHSylX/vOiztNnNx0 5kIg== MIME-Version: 1.0 X-Received: by 10.180.104.73 with SMTP id gc9mr600903wib.13.1375763806333; Mon, 05 Aug 2013 21:36:46 -0700 (PDT) Received: by 10.217.65.7 with HTTP; Mon, 5 Aug 2013 21:36:46 -0700 (PDT) In-Reply-To: <52007600.6010309@apache.org> References: <52007600.6010309@apache.org> X-Goomoji-Body: true Date: Tue, 6 Aug 2013 12:36:46 +0800 Message-ID: Subject: Re: Running Example Error: Child Error From: Zeyuan Xiang To: user@giraph.apache.org Content-Type: multipart/related; boundary=f46d044282bcf8b38f04e33ff8e2 X-Virus-Checked: Checked by ClamAV on apache.org --f46d044282bcf8b38f04e33ff8e2 Content-Type: multipart/alternative; boundary=f46d044282bcf8b38a04e33ff8e1 --f46d044282bcf8b38a04e33ff8e1 Content-Type: text/plain; charset=ISO-8859-1 Hi, I didn't install Zookeeper, is it necessary? (The example tutorials didn't show it.) On my master logs, I only find these about Zookeeper: *Caused by: java.lang.IllegalStateException: exists: Failed to check /_hadoopBsp/job_201308051938_0002/_applicationAttemptsDir/0/_superstepDir/-1/_addressesAndPartitions after 3 tries!* * at org.apache.giraph.zk.ZooKeeperExt.exists(ZooKeeperExt.java:369)* * at org.apache.giraph.worker.BspServiceWorker.startSuperstep(BspServiceWorker.java:686) * * at org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:482)* * at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:246)* * at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:91)* Thank you for your reply! Best Regards, Your sincerely Xiang. On Tue, Aug 6, 2013 at 12:05 PM, Avery Ching wrote: > Does the master log show ZooKeeper starting okay? > > > On 8/5/13 6:06 AM, Zeyuan Xiang wrote: > > I used Hadoop 1.1 which is a real cluster with four slave node and I > build success. > > When I refer to reference "Shortest Paths", step by step, I got an error > as follows: > * **java.lang.Throwable: Child Error * > * at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242) > Caused by: java.io.IOException: Task process exit with nonzero > status of 1. > at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229)* > * * > *what's more, all the example produce this same error.......[?]* > *And I find someone also encounter this problem, but it seems not solved* > The command: > > ---------------------------------------------------------------------------------------------------------- > hadoop jar > /usr/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar > org.apache.giraph.GiraphRunner > org.apache.giraph.examples.SimpleShortestPathsComputation > -vif > org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat > -vip shortest/shortest.json > -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat > -op outShort -w 1 > > ---------------------------------------------------------------------------------------------------------- > > Running info: > > ---------------------------------------------------------------------------------------------------------- > 13/08/02 10:10:27 INFO utils.ConfigurationUtils: No edge input format > specified. Ensure your InputFormat does not require one. > 13/08/02 10:10:27 INFO job.GiraphJob: run: Since checkpointing is disabled > (default), do not allow any task retries (setting mapred.map.max.attempts = > 0, old value = 4) > 13/08/02 10:10:33 INFO mapred.JobClient: Running job: > job_201308020915_0002 > 13/08/02 10:10:34 INFO mapred.JobClient: map 0% reduce 0% > 13/08/02 10:10:51 INFO mapred.JobClient: map 50% reduce 0% > 13/08/02 10:10:54 INFO mapred.JobClient: map 100% reduce 0% > 13/08/02 10:10:55 INFO mapred.JobClient: map 50% reduce 0% > 13/08/02 10:21:42 INFO mapred.JobClient: map 0% reduce 0% > 13/08/02 10:21:42 INFO mapred.JobClient: Job complete: > job_201308020915_0002 > 13/08/02 10:21:42 INFO mapred.JobClient: Counters: 6 > 13/08/02 10:21:42 INFO mapred.JobClient: Job Counters > 13/08/02 10:21:42 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=658594 > 13/08/02 10:21:42 INFO mapred.JobClient: Total time spent by all > reduces waiting after reserving slots (ms)=0 > 13/08/02 10:21:42 INFO mapred.JobClient: Total time spent by all maps > waiting after reserving slots (ms)=0 > 13/08/02 10:21:42 INFO mapred.JobClient: Launched map tasks=2 > 13/08/02 10:21:42 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0 > 13/08/02 10:21:42 INFO mapred.JobClient: Failed map tasks=1 > > ---------------------------------------------------------------------------------------------------------- > > Logs: > > ---------------------------------------------------------------------------------------------------------- > 2013-08-02 10:10:50,721 INFO org.apache.hadoop.mapred.TaskInProgress: > Error from attempt_201308020915_0002_m_000000_0: java.lang.Throwable: Child > Error > at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) > Caused by: java.io.IOException: Task process exit with nonzero status of 1. > at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) > > 2013-08-02 10:10:53,765 INFO org.apache.hadoop.mapred.TaskInProgress: > TaskInProgress task_201308020915_0002_m_000000 has failed 0 times. > 2013-08-02 10:10:53,765 INFO org.apache.hadoop.mapred.JobTracker: Removing > task 'attempt_201308020915_0002_m_000000_0' > 2013-08-02 10:10:53,765 INFO org.apache.hadoop.mapred.JobTracker: Adding > task (TASK_CLEANUP) 'attempt_201308020915_0002_m_000000_0' to tip > task_201308020915_0002_m_000000, for tracker > 'tracker_Slave3.Hadoop:Slave3.Hadoop/127.0.0.1:49172' > 2013-08-02 10:10:54,070 INFO org.apache.hadoop.mapred.TaskInProgress: > TaskInProgress task_201308020915_0002_m_000000 has failed 1 times. > 2013-08-02 10:10:54,071 INFO org.apache.hadoop.mapred.JobTracker: Removing > task 'attempt_201308020915_0002_m_000000_0' > 2013-08-02 10:11:40,700 INFO org.apache.hadoop.mapred.TaskInProgress: > Error from attempt_201308020915_0002_m_000001_0: > java.lang.IllegalStateException: run: Caught an unrecoverable exception > exists: Failed to check > /_hadoopBsp/job_201308020915_0002/_applicationAttemptsDir/0/_superstepDir/-1/_addressesAndPartitions > after 3 tries! > at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:101) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136) > at org.apache.hadoop.mapred.Child.main(Child.java:249) > Caused by: java.lang.IllegalStateException: exists: Failed to check > /_hadoopBsp/job_201308020915_0002/_applicationAttemptsDir/0/_superstepDir/-1/_addressesAndPartitions > after 3 tries! > at org.apache.giraph.zk.ZooKeeperExt.exists(ZooKeeperExt.java:369) > at > org.apache.giraph.worker.BspServiceWorker.startSuperstep(BspServiceWorker.java:686) > at > org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:482) > at > org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:246) > at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:91) > ... 7 more > > 2013-08-02 10:21:41,001 INFO org.apache.hadoop.mapred.TaskInProgress: > Error from attempt_201308020915_0002_m_000001_0: Task > attempt_201308020915_0002_m_000001_0 failed to report status for 600 > seconds. Killing! > > ----------------------------------------------------------------------------------------------------- > > I also use "mvn -Phadoop_1.0 clean package" and "mvn > -pHadoop=non_secure", but it did not take effect. Can anybody give me some > advice? > Thank you very much !!! > > And is ZooKeeper necessary to Giraph, do I need install it? > > Best regards, > Your sincerely Allan Xiang. > > > --f46d044282bcf8b38a04e33ff8e1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi, I didn't install Zookeeper, is it necessary? (The = example tutorials didn't show it.)
On my master logs, I only find t= hese about Zookeeper:
Caused by: = java.lang.IllegalStateException: exists: Failed to check /_hadoopBsp/job_20= 1308051938_0002/_applicationAttemptsDir/0/_superstepDir/-1/_addressesAndPar= titions after 3 tries!
=A0 =A0 =A0 =A0 at org.apache.giraph.zk.ZooKeeperExt.exi= sts(ZooKeeperExt.java:369)
=A0 =A0 =A0 =A0 at org.apache.giraph.worker= .BspServiceWorker.startSuperstep(BspServiceWorker.java:686)
=A0 =A0 =A0 =A0 at org.apache.giraph.worke= r.BspServiceWorker.setup(BspServiceWorker.java:482)
=A0 =A0 =A0 =A0 at org.apache.giraph.graph.= GraphTaskManager.execute(GraphTaskManager.java:246)
=A0 =A0 =A0 =A0 at org.apache.giraph.graph.GraphMa= pper.run(GraphMapper.java:91)

Thank you for your reply!

Best Regards,
Your sincerely Xiang.


On Tue, Aug 6, 2013 at 12:05 = PM, Avery Ching <aching@apache.org> wrote:
=20 =20 =20
Does the master log show ZooKeeper starting okay?


On 8/5/13 6:06 AM, Zeyuan Xiang wrote:
I used Hadoop 1.1 which is a real cluster with four slave node and I build success.
=A0
When I refer to reference "Shortest Paths", step by step, I got an= error as follows:
java= .lang.Throwable: Child Error=A0
=A0 =A0 =A0 =A0 =A0at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242)<= /span>
=A0 =A0 =A0 =A0 =A0Caused by: java.io.IOException: Task process e= xit with nonzero status of 1.
=A0 =A0 =A0 =A0 =A0at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229)<= /span>
=A0 =A0 =A0
what's more, all the example produce this same error.......
And I find someone also encounter this problem, but it seems not =A0solved
The command:=A0
-----------------------------------------------------------------------= -----------------------------------
hadoop jar /usr/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAP= SHOT-for-hadoop-1.0.2-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation=A0<= /span>
-vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexI= nputFormat=A0
-vip shortest/shortest.json=A0
-of org.apache.giraph.io.formats.IdWithValueTextOutputFormat=A0
-op outShort -w 1
-----------------------------------------------------------------------= -----------------------------------

Running info:
------------------------------------------------= ----------------------------------------------------------
13/08/02 10:10:27 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one.
13/08/02 10:10:27 INFO job.GiraphJob: run: Since checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts =3D 0, old value =3D 4)
13/08/02 10:10:33 INFO mapred.JobClient: Running job: job_201308020915_0002
13/08/02 10:10:34 INFO mapred.JobClient: =A0map 0% reduce 0%
13/08/02 10:10:51 INFO mapred.JobClient: =A0map 50% reduce 0%
13/08/02 10:10:54 INFO mapred.JobClient: =A0map 100% reduce 0%
13/08/02 10:10:55 INFO mapred.JobClient: =A0map 50% reduce 0%
13/08/02 10:21:42 INFO mapred.JobClient: =A0map 0% reduce 0%
13/08/02 10:21:42 INFO mapred.JobClient: Job complete: job_201308020915_0002
13/08/02 10:21:42 INFO mapred.JobClient: Counters: 6
13/08/02 10:21:42 INFO mapred.JobClient: =A0 Job Counters=A0
13/08/02 10:21:42 INFO mapred.JobClient: =A0 =A0 SLOTS_MILLIS_MAPS=3D658594
13/08/02 10:21:42 INFO mapred.JobClient: =A0 =A0 Total time spent by all reduces waiting after reserving slots (ms)=3D0
13/08/02 10:21:42 INFO mapred.JobClient: =A0 =A0 Total time spent by all maps waiting after reserving slots (ms)=3D0
13/08/02 10:21:42 INFO mapred.JobClient: =A0 =A0 Launched map tasks=3D= 2
13/08/02 10:21:42 INFO mapred.JobClient: =A0 =A0 SLOTS_MILLIS_REDUCES= =3D0
13/08/02 10:21:42 INFO mapred.JobClient: =A0 =A0 Failed map tasks=3D1<= /div>
----------------= ---------------------------------------------------------------------------= ---------------

Logs:
----------------= ---------------------------------------------------------------------------= ---------------
2013-08-= 02 10:10:50,721 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201308020915_0002_m_000000_0: java.lang.Throwable: Child Error
=A0 =A0 = =A0 =A0 at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:2= 71)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
=A0 =A0 = =A0 =A0 at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:2= 58)

2013-08-= 02 10:10:53,765 INFO org.apache.hadoop.mapred.TaskInProgress: TaskInProgress task_201308020915_0002_m_000000 has failed 0 times.
2013-08-= 02 10:10:53,765 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201308020915_0002_m_000000_0&#= 39;
2013-08-= 02 10:10:53,765 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201308020915_0002_m_000000_0' to tip task_201308020915_0002_m_000000, for tracker 'tracker_Slave3.Hadoop:Slave3.Hadoop/127.0.0.1:49172'
2013-08-= 02 10:10:54,070 INFO org.apache.hadoop.mapred.TaskInProgress: TaskInProgress task_201308020915_0002_m_000000 has failed 1 times.
2013-08-= 02 10:10:54,071 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201308020915_0002_m_000000_0&#= 39;
2013-08-= 02 10:11:40,700 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201308020915_0002_m_000001_0: java.lang.IllegalStateException: run: Caught an unrecoverable exception exists: Failed to check /_hadoopBsp/job_201308020915_0002/_applicationAttemptsDir= /0/_superstepDir/-1/_addressesAndPartitions after 3 tries!
=A0 =A0 = =A0 =A0 at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:= 101)
=A0 =A0 = =A0 =A0 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.jav= a:764)
=A0 =A0 = =A0 =A0 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
=A0 =A0 = =A0 =A0 at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
=A0 =A0 = =A0 =A0 at java.security.AccessController.doPrivileged(Native Method)
=A0 =A0 = =A0 =A0 at javax.security.auth.Subject.doAs(Subject.java:396)
=A0 =A0 = =A0 =A0 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.j= ava:1136)
=A0 =A0 = =A0 =A0 at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalStateException: exists: Failed to check /_hadoopBsp/job_201308020915_0002/_applicationAttemptsDir= /0/_superstepDir/-1/_addressesAndPartitions after 3 tries!
=A0 =A0 = =A0 =A0 at org.apache.giraph.zk.ZooKeeperExt.exists(ZooKeeperExt.jav= a:369)
=A0 =A0 = =A0 =A0 at org.apache.giraph.worker.BspServiceWorker.startSuperstep(BspServiceWorker.j= ava:686)
=A0 =A0 = =A0 =A0 at org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:482)<= /span>
=A0 =A0 = =A0 =A0 at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:246)=
=A0 =A0 = =A0 =A0 at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:= 91)
=A0 =A0 = =A0 =A0 ... 7 more

2013-08-= 02 10:21:41,001 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201308020915_0002_m_000001_0: Task attempt_201308020915_0002_m_000001_0 failed to report status for 600 seconds. Killing!
----------= ---------------------------------------------------------------------------= ----------------

=A0 =A0 =A0 =A0 I also use =A0"mvn -Phadoop_1.0 clean package" =A0and =A0"= ;mvn -pHadoop=3Dnon_secure", but it did not take effect. Can anybody give me some advice?
=A0 =A0 =A0 =A0 Thank you very much !!! =A0

And is ZooKeeper necessary to Giraph, do I need install it?

Best regards,
Your sincerely Allan Xiang.


--f46d044282bcf8b38a04e33ff8e1-- --f46d044282bcf8b38f04e33ff8e2 Content-Type: image/gif; name="B0E.gif" Content-Transfer-Encoding: base64 X-Attachment-Id: ezweb_ne_jp.B0E@goomoji.gmail Content-ID: R0lGODlhDwAOALMPAP/t9p8QXM8xa/9rrf8vmPg0kmoAOv+WxP+62OI0e/9Ypf9Am/Mxi/8znP8z mQAAACH/C05FVFNDQVBFMi4wAwEAAAAh+QQJMgAPACwAAAAADwAOAAAEW/A9R4hLMukgp1sLUQhJ YybcQwzIoTRM0TizwC0IcIRO79sFHGBg8flQk8Ow6GuMOAwFgmjsMQKGh6AwcDGdto4gOmg+s2IG iADGdsQJ2fn9FpBsaLoYr9e76REAIfkECTIADwAsAAAAAA8ADgAABF/wPUeISzLpIKdbC1F4TZNw DzEgh0J4TuMI3IIAR9jAc1DYgIHFwTtNDsEhqUB7MBQIoWNKZQQMD0Fh0HpNG0xU9jmggmnYjoAB IpyvHXWi8E7HJQJBAn2/5+F9d4BxEQAh+QQFMgAPACwAAAAADwAOAAAEXvA9R4hL8qUUsnPLQhRS Y3ISMSCHIn1O4wjdggDH8sJzUNiAgWX3QTkOQYvj1SjQHgwFQvjZMQKGh6AwaBGYzo5EEB2AadkM WfdoojPqBEmLhcMFAkzdfn8Y0nyBdhEAOw== --f46d044282bcf8b38f04e33ff8e2--