Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9650F1096C for ; Fri, 20 Dec 2013 23:33:36 +0000 (UTC) Received: (qmail 38514 invoked by uid 500); 20 Dec 2013 23:33:36 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 38475 invoked by uid 500); 20 Dec 2013 23:33:36 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 38467 invoked by uid 99); 20 Dec 2013 23:33:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Dec 2013 23:33:36 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,LOTS_OF_MONEY,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rohitbhat.nitk@gmail.com designates 209.85.216.180 as permitted sender) Received: from [209.85.216.180] (HELO mail-qc0-f180.google.com) (209.85.216.180) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Dec 2013 23:33:31 +0000 Received: by mail-qc0-f180.google.com with SMTP id w7so2912100qcr.11 for ; Fri, 20 Dec 2013 15:33:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Qfg0mCY+oyLc0lfy6+RKfKza4XjTxCTXCKsFz2+JLZg=; b=yCdUtYF5DmmELrWaWN2Zzb6FPnCZL0poGNFVC6w9HdIL27SQjk4pXJJ6wow1qLFToU EoxKJ2vFI9NeHWxXdApz78o71YUKD32o4YLtZ4u/tforH1YEaNL+Idc9dwgv6D/Z/yNO kz68rTQsmHN53LnvFuCgvCHdGXzZJMOEJjMeJ3MPf/EnKyjsbUj3Jw5xoS4b0nPMM/sR hk3bv3ewnvWGDBbTQGs1NaXXI15pWXASVcSSVePhOvzPqyhVBe9LlA2BMHByJiRJarbU Slrt4fddHZs04Nd0+b3kYrMPkx1h/3/e2L6QNbTgV+Tf1swY1rkUn7KQHimIDNZy2vkJ OElw== MIME-Version: 1.0 X-Received: by 10.49.74.138 with SMTP id t10mr19214287qev.21.1387582390249; Fri, 20 Dec 2013 15:33:10 -0800 (PST) Received: by 10.96.165.234 with HTTP; Fri, 20 Dec 2013 15:33:10 -0800 (PST) In-Reply-To: References: <198091226.KO6f1kuK42@chronos7> <2460764.qWxuyqPXN3@chronos7> Date: Fri, 20 Dec 2013 17:33:10 -0600 Message-ID: Subject: Re: Issue while executing SimpleShortestPathsComputation From: Rohit Bhat To: user@giraph.apache.org Cc: Vishal Mishra , Yong Guo Content-Type: multipart/alternative; boundary=047d7bdc13fe77ac2b04edffb34f X-Virus-Checked: Checked by ClamAV on apache.org --047d7bdc13fe77ac2b04edffb34f Content-Type: text/plain; charset=ISO-8859-1 It worked!! Thanks. On Fri, Dec 20, 2013 at 4:56 PM, Alexandre Fonseca < alexandrejorgefonseca@gmail.com> wrote: > Hi, > > I submitted a patch for this some time ago at > https://issues.apache.org/jira/browse/GIRAPH-811 > > It should fix your problem, hopefully. > > Regards, > Alexandre > On 20 Dec 2013 23:42, "Rohit Bhat" wrote: > >> Hi Alexandre, >> >> I had made the suggested change in mapred-site.xml and now the job >> atleast seems to start but it does not complete. >> >> I am trying out the SimpleShortestPathsComputation example. It remains in >> the running state and the following message is displayed on stdout: >> >> 13/12/20 14:39:32 INFO yarn.GiraphYarnClient: Giraph: >> org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 514.07 >> secs >> 13/12/20 14:39:32 INFO yarn.GiraphYarnClient: >> appattempt_1387571436273_0001_000001, State: RUNNING, Containers used: 2 >> >> In the log file i see this message: >> >> 2013-12-20 14:31:10,891 INFO [org.apache.giraph.master.MasterThread] >> master.BspServiceMaster (BspServiceMaster.java:cleanUpZooKeeper(1711)) - >> cleanUpZooKeeper: Node >> /_hadoopBsp/giraph_yarn_application_1387571436273_0001/_cleanedUpDir a$ >> 2013-12-20 14:31:10,900 INFO [org.apache.giraph.master.MasterThread] >> master.BspServiceMaster (BspServiceMaster.java:cleanUpZooKeeper(1735)) - >> cleanUpZooKeeper: Got 2 of 1 desired children from >> /_hadoopBsp/giraph_yarn_application_138757$ >> $7571436273_0001/_cleanedUpDir to change since only got 2 nodes. >> >> Any reason why this is happening? >> >> Thanks, >> Rohit >> >> >> On Mon, Dec 9, 2013 at 3:45 PM, Alexandre Fonseca < >> alexandrejorgefonseca@gmail.com> wrote: >> >>> I have confirmed a bug in Giraph's YARN code related to the default >>> MapReduce >>> configuration. Either provide your own mapreduce.application.classpath in >>> mapred-site.xml or apply the patch described here: >>> https://issues.apache.org/jira/browse/GIRAPH-814 >>> >>> Application runs successfully if using custom >>> mapreduce.application.classpath >>> or no default mapreduce.application.classpath + patch. Application fails >>> if >>> using default mapreduce.application.classpath and no patch. >>> >>> Cheers, >>> Alex >>> >>> On Monday 09 December 2013 22:05:20 Alexandre Fonseca wrote: >>> > mapreduce.application.classpath >>> >> >> --047d7bdc13fe77ac2b04edffb34f Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
It worked!! Thanks.

On Fri, Dec 20, 2013 at 4:56 PM, Alexandre Fon= seca <alexandrejorgefonseca@gmail.com> wrote:<= br>

Hi,

I submitted a patch for this some time ago at https://is= sues.apache.org/jira/browse/GIRAPH-811

It should fix your problem, hopefully.

Regards,
Alexandre

On 20 Dec 2013 23:42, "Rohit Bhat" <= ;rohitbhat.ni= tk@gmail.com> wrote:
Hi Alexandre,

I had made the suggested = change in mapred-site.xml and now the job atleast seems to start but it doe= s not complete.

I am trying out the SimpleShortest= PathsComputation example. It remains in the running state and the following= message is displayed on stdout:

13/12/20 14:39:32 INFO yarn.GiraphYarnClient: Gira= ph: org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 514= .07 secs
13/12/20 14:39:32 INFO yarn.GiraphYarnClient: appattempt= _1387571436273_0001_000001, State: RUNNING, Containers used: 2

In the log file i see this message:
2013-12-20 14:31:10,891 INFO =A0[org.apache.giraph.master.= MasterThread] master.BspServiceMaster (BspServiceMaster.java:cleanUpZooKeep= er(1711)) - cleanUpZooKeeper: Node /_hadoopBsp/giraph_yarn_application_1387= 571436273_0001/_cleanedUpDir a$
2013-12-20 14:31:10,900 INFO =A0[org.apache.giraph.master.MasterThread= ] master.BspServiceMaster (BspServiceMaster.java:cleanUpZooKeeper(1735)) - = cleanUpZooKeeper: Got 2 of 1 desired children from /_hadoopBsp/giraph_yarn_= application_138757$
$7571436273_0001/_cleanedUpDir to change since only got 2 nodes.
=

Any reason why this is happening?

<= /div>
Thanks,
Rohit


On Mon, Dec 9, 2013 at 3:45 PM, Alexandr= e Fonseca <alexandrejorgefonseca@gmail.com> wr= ote:
I have confirmed a bug in Giraph's YARN = code related to the default MapReduce
configuration. Either provide your own mapreduce.application.classpath in mapred-site.xml or apply the patch described here:
https://issues.apache.org/jira/browse/GIRAPH-814

Application runs successfully if using custom mapreduce.application.classpa= th
or no default mapreduce.application.classpath + patch. Application fails if=
using default mapreduce.application.classpath and no patch.

Cheers,
Alex

On Monday 09 December 2013 22:05:20 Alexandre Fonseca wrote:
> mapreduce.application.classpath


--047d7bdc13fe77ac2b04edffb34f--