Return-Path: 
 <user-return-1584-apmail-giraph-user-archive=giraph.apache.org@giraph.apache.org>
X-Original-To: apmail-giraph-user-archive@www.apache.org
Delivered-To: apmail-giraph-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1F26910226
	for <apmail-giraph-user-archive@www.apache.org>;
 Mon,  7 Oct 2013 02:02:02 +0000 (UTC)
Received: (qmail 57570 invoked by uid 500); 7 Oct 2013 02:02:01 -0000
Delivered-To: apmail-giraph-user-archive@giraph.apache.org
Received: (qmail 57532 invoked by uid 500); 7 Oct 2013 02:02:01 -0000
Mailing-List: contact user-help@giraph.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@giraph.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@giraph.apache.org>
List-Post: <mailto:user@giraph.apache.org>
List-Id: <user.giraph.apache.org>
Reply-To: user@giraph.apache.org
Delivered-To: mailing list user@giraph.apache.org
Received: (qmail 57524 invoked by uid 99); 7 Oct 2013 02:02:01 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Oct 2013 02:02:01 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
	tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
Received: from [209.85.212.180] (HELO mail-wi0-f180.google.com)
 (209.85.212.180)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Oct 2013 02:01:57 +0000
Received: by mail-wi0-f180.google.com with SMTP id hj3so4081698wib.13
        for <user@giraph.apache.org>; Sun, 06 Oct 2013 19:01:36 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20130820;
        h=x-gm-message-state:mime-version:in-reply-to:references:date
         :message-id:subject:from:to:content-type;
        bh=pn4ejnlaUtE2ORlmXRuj3WIgrCdFDFDdbdz/r78lYok=;
        b=NduAinpG6BQX9z8vjyue7yCx994kEhbYBwmgXeFzovWDnmJheId1MzzcDUK9NiI6HQ
         lRhfuxPUNh0srfqRXr+5W/ynoP7NHSwfVMfVOFSmwKIogRJpbKpu6JjUeaa9Nuo7NgJk
         hp7qLolHPp05sd0S7KErLLy6YpqHy4uGlNhdG/nqIGkpe6rzwy/R3KruIat+mLSVsgtp
         DTUAl+yY6mkGimuOG0WNvlM+rXbbnUyvivkr38eYXUnxahYl0OQ3ELA7INHB/Nji/BeJ
         9Ks7Dwv88wDXConTWweOCQQyGpFY7GwQxpN2TLTZLE3snZKyLAkJCpfs3n/QnRonbBal
         i9fw==
X-Gm-Message-State: 
 ALoCoQmZlW/nwa7JhSKC1DMjE1GigYqJvJeWtGXyZ8Vm+EcF3IJOsZl6iyAjL6x/WfS3r+6nrmso
MIME-Version: 1.0
X-Received: by 10.180.198.44 with SMTP id iz12mr17061094wic.32.1381111296019;
 Sun, 06 Oct 2013 19:01:36 -0700 (PDT)
Received: by 10.194.171.194 with HTTP; Sun, 6 Oct 2013 19:01:35 -0700 (PDT)
In-Reply-To: <52520C12.8020604@sfu.ca>
References: <5251EE7E.2040602@sfu.ca>
	<5252088B.6050104@sfu.ca>
	<CACwebjQPPSTPbuYrVJeSGN7KT89fBhB-npP2zUL1tJGiSYrxLQ@mail.gmail.com>
	<52520C12.8020604@sfu.ca>
Date: Sun, 6 Oct 2013 22:01:35 -0400
Message-ID: 
 <CACwebjRKckm3z+uX-3kbwwxc1DYLyQ6XMgp83_3npjOH=6rynQ@mail.gmail.com>
Subject: Re: Giraph & yarn build
From: Milinda Pathirage <mpathira@umail.iu.edu>
To: user@giraph.apache.org
Content-Type: text/plain; charset=ISO-8859-1
X-Virus-Checked: Checked by ClamAV on apache.org

Yep, this is a bug in the code. Adding InterruptedException to method
signature in HaltApplicationUtils will fix that problem. then there
will be some checkstyle errors and findbug errors. You need to add
following exclusions to findbugs-exclude.xml in root directory of
giraph source.

<Match>
    <Class name="org.apache.giraph.yarn.GiraphYarnTask$OverrideExceptionHandler"/>
    <Bug pattern="DM_EXIT"/>
  </Match>
  <Match>
    <Class name="org.apache.giraph.yarn.YarnUtils"/>
    <Bug pattern="RV_RETURN_VALUE_IGNORED_BAD_PRACTICE"/>
  </Match>

Also skip checkstyle checks using -Dcheckstyle.skip=true system
property. I was able to get hadoop_yarn profile built following above
steps.

Thanks
Milinda

On Sun, Oct 6, 2013 at 9:19 PM, Matthew Laird <lairdm@sfu.ca> wrote:
> Thanks for the reply, so I just grabbed that I assume is the latest version,
> the snapshot link from git:
>
> https://git-wip-us.apache.org/repos/asf?p=giraph.git;a=tree;h=refs/heads/trunk;hb=trunk
>
> And ran the command:
>
> mvn -Dhadoop.version=2.0.5-alpha -Phadoop_yarn clean install
>
> The error I receive in this situation is:
>
> [INFO] 2 errors
> [INFO] -------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Giraph Parent .............................. SUCCESS [1.593s]
> [INFO] Apache Giraph Core ................................ FAILURE [23.522s]
> [INFO] Apache Giraph Examples ............................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 25.574s
> [INFO] Finished at: Sun Oct 06 18:17:21 PDT 2013
> [INFO] Final Memory: 37M/692M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:3.0:compile (default-compile)
> on project giraph-core: Compilation failure: Compilation failure:
> [ERROR]
> /opt/giraph/giraph-core/target/munged/main/org/apache/giraph/job/HaltApplicationUtils.java:[78,49]
> unreported exception java.lang.InterruptedException; must be caught or
> declared to be thrown
> [ERROR]
> /opt/giraph/giraph-core/target/munged/main/org/apache/giraph/job/HaltApplicationUtils.java:[81,50]
> unreported exception java.lang.InterruptedException; must be caught or
> declared to be thrown
>
> That looks like a bug in the code?
>
> Thanks.
>
>
> On 06/10/13 18:13, Milinda Pathirage wrote:
>>
>> AFAIK, you need to specify hadoop.version system property. So command
>> to build giraph with YARN (2.0.5) should be something like following.
>>
>> mvn -Phadoop_yarn -Dhadoop.version=2.0.5-alpha clean install
>>
>> Hope this helps.
>>
>> Thanks
>> Milinda
>>
>>
>> On Sun, Oct 6, 2013 at 9:04 PM, Matthew Laird <lairdm@sfu.ca> wrote:
>>>
>>> Further, I let it go and after two hours I see the file:
>>>
>>>
>>> /giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphYarnTask.java.rej
>>>
>>> is now 295GB in size.  I'm not sure what it's stuck doing after applying
>>> this patch...
>>>
>>> Thanks.
>>>
>>>
>>> On 06/10/13 16:13, Matthew Laird wrote:
>>>>
>>>> Hello,
>>>>
>>>> I'm trying to build giraph against Hadoop 2.0.5, and I've been browsing
>>>> the mailing list archives but am still having an issue. I found the
>>>> previous
>>>> thread where Eli points to
>>>>
>>>> https://issues.apache.org/jira/browse/GIRAPH-688
>>>>
>>>> I've grabbed the patch and applied it against a clone from git
>>>> (http://git-wip-us.apache.org/repos/asf/giraph.git, is that the correct
>>>> place to get the latest trunk?)  Just like the other fellow asking a few
>>>> months ago, patch complains the patch has been applied before.
>>>>
>>>> Once applied I run the suggested build command:
>>>>
>>>> mvn -U -Phadoop_yarn clean install
>>>>
>>>> It reaches
>>>>
>>>> [INFO] --- munge-maven-plugin:1.0:munge (munge) @ giraph-core ---
>>>>
>>>> And so far it's been sitting there about 20 minutes at this step, in
>>>> another window I can see it's working hard doing something, but I'm
>>>> assuming
>>>> it's stuck doing... I'm not sure what.
>>>>
>>>> Without the patch I receive the same error the other fellow was having
>>>> about dependancies for hadoop not being satisfied.
>>>>
>>>> Any advice on what might be going on, or is there a better place to get
>>>> a
>>>> snapshot that has the needed patches applied? (I see a lot of commits
>>>> since
>>>> the original thread)
>>>>
>>>> Thanks!
>>>>
>>
>>
>



-- 
Milinda Pathirage

twitter: milindalakmal
skype: milinda.pathirage
blog: http://milinda.pathirage.org