Return-Path: 
 <giraph-user-return-122-apmail-incubator-giraph-user-archive=incubator.apache.org@incubator.apache.org>
X-Original-To: apmail-incubator-giraph-user-archive@minotaur.apache.org
Delivered-To: apmail-incubator-giraph-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 7C7F69C9C
	for <apmail-incubator-giraph-user-archive@minotaur.apache.org>;
 Thu, 10 Nov 2011 15:31:50 +0000 (UTC)
Received: (qmail 61136 invoked by uid 500); 10 Nov 2011 15:31:50 -0000
Delivered-To: apmail-incubator-giraph-user-archive@incubator.apache.org
Received: (qmail 61084 invoked by uid 500); 10 Nov 2011 15:31:50 -0000
Mailing-List: contact giraph-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:giraph-user-help@incubator.apache.org>
List-Unsubscribe: <mailto:giraph-user-unsubscribe@incubator.apache.org>
List-Post: <mailto:giraph-user@incubator.apache.org>
List-Id: <giraph-user.incubator.apache.org>
Reply-To: giraph-user@incubator.apache.org
Delivered-To: mailing list giraph-user@incubator.apache.org
Received: (qmail 61076 invoked by uid 99); 10 Nov 2011 15:31:50 -0000
Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Nov 2011 15:31:50 +0000
Received: from localhost (HELO mail-ww0-f43.google.com) (127.0.0.1)
  (smtp-auth username gdfm, mechanism plain)
  by minotaur.apache.org (qpsmtpd/0.29) with ESMTP;
 Thu, 10 Nov 2011 15:31:50 +0000
Received: by wwp14 with SMTP id 14so543672wwp.0
        for <giraph-user@incubator.apache.org>;
 Thu, 10 Nov 2011 07:31:48 -0800 (PST)
Received: by 10.216.220.226 with SMTP id o76mr2189027wep.108.1320939108141;
 Thu, 10 Nov 2011 07:31:48 -0800 (PST)
MIME-Version: 1.0
Received: by 10.216.177.146 with HTTP; Thu, 10 Nov 2011 07:31:07 -0800 (PST)
In-Reply-To: 
 <CAFJOoJdZs7HT08POFaS1FhgLBTqyVqbkrGz-nUwe2Ob-nDmq8Q@mail.gmail.com>
References: 
 <CAGD7CYUApY7-UZSMGpq=w8nqcjohRs9mb1gAjaT4WpAqY6sgDw@mail.gmail.com>
 <4EB55FA0.5070707@apache.org>
 <CAFJOoJfYrbU=N6BvmvuCVN9Aj-YvRb4Cef5_sNxLB8giZR4X6w@mail.gmail.com>
 <CAFJOoJf0p5GLRNuX5tKMUACSO8JbfQg6c+=0xP9Jsp4R-Y-WFA@mail.gmail.com>
 <4EBA61C5.5090305@apache.org>
 <CAFJOoJdZs7HT08POFaS1FhgLBTqyVqbkrGz-nUwe2Ob-nDmq8Q@mail.gmail.com>
From: Gianmarco De Francisci Morales <gdfm@apache.org>
Date: Thu, 10 Nov 2011 16:31:07 +0100
Message-ID: 
 <CAGD7CYWpt38QT0jt2ya5pka49zkuMXhGUkfv621SNsX=6cSDUg@mail.gmail.com>
Subject: Re: Packaging a Giraph application in a jar
To: giraph-user@incubator.apache.org
Content-Type: multipart/alternative; boundary=0016364d1e7d4f8a4404b1631ad9

--0016364d1e7d4f8a4404b1631ad9
Content-Type: text/plain; charset=ISO-8859-1

Nice!
It looks cleaner than my ant+ivy hack :)

Thanks for sharing,
--
Gianmarco



On Thu, Nov 10, 2011 at 16:18, Claudio Martella
<claudio.martella@gmail.com>wrote:

> Ok,
>
> quite basically this is my pom.xml:
>
> <project xmlns="http://maven.apache.org/POM/4.0.0"
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>        xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
> http://maven.apache.org/maven-v4_0_0.xsd">
>        <modelVersion>4.0.0</modelVersion>
>        <groupId>org.acaro.graffiti</groupId>
>        <artifactId>graffiti</artifactId>
>        <packaging>jar</packaging>
>        <version>1.0-SNAPSHOT</version>
>        <name>graffiti</name>
>        <url>http://maven.apache.org</url>
>        <build>
>                <plugins>
>                        <plugin>
>                                <groupId>org.apache.maven.plugins</groupId>
>
>  <artifactId>maven-assembly-plugin</artifactId>
>                                <version>2.2</version>
>                                <configuration>
>
>  <outputDirectory>target</outputDirectory>
>                                        <descriptorRefs>
>
>  <descriptorRef>jar-with-dependencies</descriptorRef>
>                                        </descriptorRefs>
>                                </configuration>
>                                <executions>
>                                        <execution>
>                                                <id>make-assembly</id>
>                                                <phase>compile</phase>
>                                                <goals>
>                                                        <goal>single</goal>
>                                                </goals>
>                                        </execution>
>                                </executions>
>                        </plugin>
>                        <plugin>
>                                <groupId>org.apache.maven.plugins</groupId>
>
>  <artifactId>maven-eclipse-plugin</artifactId>
>                                <configuration>
>
>  <downloadSources>true</downloadSources>
>
>  <downloadJavadocs>true</downloadJavadocs>
>                                </configuration>
>                        </plugin>
>                        <plugin>
>                                <groupId>org.apache.maven.plugins</groupId>
>                                <artifactId>maven-shade-plugin</artifactId>
>                                <version>1.5</version>
>                                <executions>
>                                        <execution>
>                                                <phase>package</phase>
>                                                <goals>
>                                                        <goal>shade</goal>
>                                                </goals>
>                                                <configuration>
>                                                </configuration>
>                                        </execution>
>                                </executions>
>                        </plugin>
>                </plugins>
>        </build>
>        <dependencies>
>                <dependency>
>                        <groupId>junit</groupId>
>                        <artifactId>junit</artifactId>
>                        <version>4.8.2</version>
>                        <scope>test</scope>
>                </dependency>
>                <dependency>
>                        <groupId>ch.qos.logback</groupId>
>                        <artifactId>logback-classic</artifactId>
>                        <version>0.9.27</version>
>                </dependency>
>                <dependency>
>                        <groupId>com.google.guava</groupId>
>                        <artifactId>guava</artifactId>
>                        <version>r09</version>
>                </dependency>
>                <dependency>
>                        <groupId>org.antlr</groupId>
>                        <artifactId>antlr</artifactId>
>                        <version>3.3</version>
>                </dependency>
>                <dependency>
>                        <groupId>org.apache.giraph</groupId>
>                        <artifactId>giraph</artifactId>
>                        <version>0.70</version>
>                </dependency>
>                <dependency>
>                        <groupId>org.apache.hadoop</groupId>
>                        <artifactId>hadoop-core</artifactId>
>                        <version>0.20.204.0</version>
>                        <scope>provided</scope>
>                </dependency>
>        </dependencies>
> </project>
>
>
> You set your project dependecies as usual, set hadoop-core (you don't
> really need it in the job jar) as <provided> and then use the
> maven-shade (http://maven.apache.org/plugins/maven-shade-plugin/). At
> package goal it will upack your dependencies and re-pack them along
> with your project classes in an uberjar.
>
> maven-shade allows you to set excludes in case of conflicts.
>
> Easy, automatic and clean.
>
>
> Hope this helps,
> Claudio
>
> On Wed, Nov 9, 2011 at 12:19 PM, Avery Ching <aching@apache.org> wrote:
> > Would be great if you can document what you did. =)
> >
> > Thanks,
> >
> > Avery
> >
> > On 11/8/11 3:13 PM, Claudio Martella wrote:
> >>
> >> Sorry guys, may bad.
> >>
> >> Was calling job.waitForCompletion() directly. I've been coding
> >> standard mapreduce whole weekend...
> >>
> >> Anyway I got a solution for clean packaging of your own application
> >> over giraph, and that is exactly using maven-shade-plugin. it will
> >> prepare the uberjar for you.
> >>
> >> On Tue, Nov 8, 2011 at 9:33 PM, Claudio Martella
> >> <claudio.martella@gmail.com>  wrote:
> >>>
> >>> Hello list,
> >>>
> >>> I'm actually having troubles as well to get my application running.
> >>>
> >>> I've give a shot to maven-shade plugin which unpacks my dependencies
> >>> and packs them all together with my classes in a new jar.
> >>>
> >>> I attach the hierarchy of the jar so that somebody can maybe spot
> >>> what's missing, because i can't get it working. I get an identity
> >>> map-reduce job with jobconf complaining about no job jar being set.
> >>>
> >>> Any idea?
> >>>
> >>> On Sat, Nov 5, 2011 at 5:09 PM, Avery Ching<aching@apache.org>  wrote:
> >>>>
> >>>> Hi Gianmarco,
> >>>>
> >>>> You're right, most of us (to my knowledge) have been using Giraph with
> >>>> an
> >>>> uberjar as you've put it.  However, Jakob has been doing some work to
> >>>> make
> >>>> this easier.  See the below issue:
> >>>>
> >>>> https://issues.apache.org/jira/browse/GIRAPH-64
> >>>>
> >>>> If you can suggest a better approach, please add to the issue or
> create
> >>>> a
> >>>> new one if appropriate.
> >>>>
> >>>> Thanks,
> >>>>
> >>>> Avery
> >>>>
> >>>> On 11/5/11 4:11 AM, Gianmarco De Francisci Morales wrote:
> >>>>>
> >>>>> Hi community,
> >>>>>
> >>>>> I was wondering what is the current best practice to package an
> >>>>> application in a jar for deployment.
> >>>>> I tried the 'hadoop way' by putting giraph-*.jar in the /lib
> directory
> >>>>> of
> >>>>> my jar, and using the -libjars option but none of them worked. It
> looks
> >>>>> like
> >>>>> the backend classloader is doing some mess and it doesn't find my own
> >>>>> classes in the jar.
> >>>>>
> >>>>> I resorted to uncompressing the giraph-*.jar and repackaging my
> classes
> >>>>> with it, all at the same level (an uber-fat jar), but even though it
> >>>>> works
> >>>>> it doesn't sound like the right approach.
> >>>>>
> >>>>> Any suggestions?
> >>>>>
> >>>>> Thanks,
> >>>>> --
> >>>>> Gianmarco
> >>>>>
> >>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >>> --
> >>>     Claudio Martella
> >>>     claudio.martella@gmail.com
> >>>
> >>
> >>
> >
> >
>
>
>
> --
>     Claudio Martella
>     claudio.martella@gmail.com
>

--0016364d1e7d4f8a4404b1631ad9
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Nice!<div>It looks cleaner than my ant+ivy hack :)</div><div><br></div><div=
>Thanks for sharing,<br clear=3D"all">--<div>Gianmarco</div><br>
<br><br><div class=3D"gmail_quote">On Thu, Nov 10, 2011 at 16:18, Claudio M=
artella <span dir=3D"ltr">&lt;<a href=3D"mailto:claudio.martella@gmail.com"=
>claudio.martella@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"g=
mail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-l=
eft:1ex;">

Ok,<br>
<br>
quite basically this is my pom.xml:<br>
<br>
&lt;project xmlns=3D&quot;<a href=3D"http://maven.apache.org/POM/4.0.0" tar=
get=3D"_blank">http://maven.apache.org/POM/4.0.0</a>&quot;<br>
xmlns:xsi=3D&quot;<a href=3D"http://www.w3.org/2001/XMLSchema-instance" tar=
get=3D"_blank">http://www.w3.org/2001/XMLSchema-instance</a>&quot;<br>
 =A0 =A0 =A0 =A0xsi:schemaLocation=3D&quot;<a href=3D"http://maven.apache.o=
rg/POM/4.0.0" target=3D"_blank">http://maven.apache.org/POM/4.0.0</a><br>
<a href=3D"http://maven.apache.org/maven-v4_0_0.xsd" target=3D"_blank">http=
://maven.apache.org/maven-v4_0_0.xsd</a>&quot;&gt;<br>
 =A0 =A0 =A0 =A0&lt;modelVersion&gt;4.0.0&lt;/modelVersion&gt;<br>
 =A0 =A0 =A0 =A0&lt;groupId&gt;org.acaro.graffiti&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0&lt;artifactId&gt;graffiti&lt;/artifactId&gt;<br>
 =A0 =A0 =A0 =A0&lt;packaging&gt;jar&lt;/packaging&gt;<br>
 =A0 =A0 =A0 =A0&lt;version&gt;1.0-SNAPSHOT&lt;/version&gt;<br>
 =A0 =A0 =A0 =A0&lt;name&gt;graffiti&lt;/name&gt;<br>
 =A0 =A0 =A0 =A0&lt;url&gt;<a href=3D"http://maven.apache.org" target=3D"_b=
lank">http://maven.apache.org</a>&lt;/url&gt;<br>
 =A0 =A0 =A0 =A0&lt;build&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;plugins&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;plugin&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId=
&gt;org.apache.maven.plugins&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifac=
tId&gt;maven-assembly-plugin&lt;/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version=
&gt;2.2&lt;/version&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;configu=
ration&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;outputDirectory&gt;target&lt;/outputDirectory&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;descriptorRefs&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;descriptorRef&gt;jar-with-dependencies&lt;/descr=
iptorRef&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;/descriptorRefs&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/config=
uration&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;executi=
ons&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;execution&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;id&gt;make-assembly&lt;/id&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;phase&gt;compile&lt;/phase&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;goals&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;goal&gt;single&lt;/goal&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;/goals&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;/execution&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/execut=
ions&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/plugin&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;plugin&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId=
&gt;org.apache.maven.plugins&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifac=
tId&gt;maven-eclipse-plugin&lt;/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;configu=
ration&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;downloadSources&gt;true&lt;/downloadSources&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;downloadJavadocs&gt;true&lt;/downloadJavadocs&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/config=
uration&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/plugin&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;plugin&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId=
&gt;org.apache.maven.plugins&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifac=
tId&gt;maven-shade-plugin&lt;/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version=
&gt;1.5&lt;/version&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;executi=
ons&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;execution&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;phase&gt;package&lt;/phase&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;goals&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;goal&gt;shade&lt;/goal&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;/goals&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;configuration&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0&lt;/configuration&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0&lt;/execution&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/execut=
ions&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/plugin&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/plugins&gt;<br>
 =A0 =A0 =A0 =A0&lt;/build&gt;<br>
 =A0 =A0 =A0 =A0&lt;dependencies&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId&gt;junit&lt;/gr=
oupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifactId&gt;junit&lt;=
/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version&gt;4.8.2&lt;/ve=
rsion&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;scope&gt;test&lt;/scope=
&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId&gt;ch.qos.logba=
ck&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifactId&gt;logback-c=
lassic&lt;/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version&gt;0.9.27&lt;/v=
ersion&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId&gt;com.google.g=
uava&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifactId&gt;guava&lt;=
/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version&gt;r09&lt;/vers=
ion&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId&gt;org.antlr&lt=
;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifactId&gt;antlr&lt;=
/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version&gt;3.3&lt;/vers=
ion&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId&gt;org.apache.g=
iraph&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifactId&gt;giraph&lt=
;/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version&gt;0.70&lt;/ver=
sion&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;dependency&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;groupId&gt;org.apache.h=
adoop&lt;/groupId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;artifactId&gt;hadoop-co=
re&lt;/artifactId&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;version&gt;0.20.204.0&l=
t;/version&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;scope&gt;provided&lt;/s=
cope&gt;<br>
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0&lt;/dependency&gt;<br>
 =A0 =A0 =A0 =A0&lt;/dependencies&gt;<br>
&lt;/project&gt;<br>
<br>
<br>
You set your project dependecies as usual, set hadoop-core (you don&#39;t<b=
r>
really need it in the job jar) as &lt;provided&gt; and then use the<br>
maven-shade (<a href=3D"http://maven.apache.org/plugins/maven-shade-plugin/=
" target=3D"_blank">http://maven.apache.org/plugins/maven-shade-plugin/</a>=
). At<br>
package goal it will upack your dependencies and re-pack them along<br>
with your project classes in an uberjar.<br>
<br>
maven-shade allows you to set excludes in case of conflicts.<br>
<br>
Easy, automatic and clean.<br>
<br>
<br>
Hope this helps,<br>
Claudio<br>
<div><div></div><div class=3D"h5"><br>
On Wed, Nov 9, 2011 at 12:19 PM, Avery Ching &lt;<a href=3D"mailto:aching@a=
pache.org">aching@apache.org</a>&gt; wrote:<br>
&gt; Would be great if you can document what you did. =3D)<br>
&gt;<br>
&gt; Thanks,<br>
&gt;<br>
&gt; Avery<br>
&gt;<br>
&gt; On 11/8/11 3:13 PM, Claudio Martella wrote:<br>
&gt;&gt;<br>
&gt;&gt; Sorry guys, may bad.<br>
&gt;&gt;<br>
&gt;&gt; Was calling job.waitForCompletion() directly. I&#39;ve been coding=
<br>
&gt;&gt; standard mapreduce whole weekend...<br>
&gt;&gt;<br>
&gt;&gt; Anyway I got a solution for clean packaging of your own applicatio=
n<br>
&gt;&gt; over giraph, and that is exactly using maven-shade-plugin. it will=
<br>
&gt;&gt; prepare the uberjar for you.<br>
&gt;&gt;<br>
&gt;&gt; On Tue, Nov 8, 2011 at 9:33 PM, Claudio Martella<br>
&gt;&gt; &lt;<a href=3D"mailto:claudio.martella@gmail.com">claudio.martella=
@gmail.com</a>&gt; =A0wrote:<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Hello list,<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; I&#39;m actually having troubles as well to get my application=
 running.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; I&#39;ve give a shot to maven-shade plugin which unpacks my de=
pendencies<br>
&gt;&gt;&gt; and packs them all together with my classes in a new jar.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; I attach the hierarchy of the jar so that somebody can maybe s=
pot<br>
&gt;&gt;&gt; what&#39;s missing, because i can&#39;t get it working. I get =
an identity<br>
&gt;&gt;&gt; map-reduce job with jobconf complaining about no job jar being=
 set.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Any idea?<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; On Sat, Nov 5, 2011 at 5:09 PM, Avery Ching&lt;<a href=3D"mail=
to:aching@apache.org">aching@apache.org</a>&gt; =A0wrote:<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; Hi Gianmarco,<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; You&#39;re right, most of us (to my knowledge) have been u=
sing Giraph with<br>
&gt;&gt;&gt;&gt; an<br>
&gt;&gt;&gt;&gt; uberjar as you&#39;ve put it. =A0However, Jakob has been d=
oing some work to<br>
&gt;&gt;&gt;&gt; make<br>
&gt;&gt;&gt;&gt; this easier. =A0See the below issue:<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; <a href=3D"https://issues.apache.org/jira/browse/GIRAPH-64=
" target=3D"_blank">https://issues.apache.org/jira/browse/GIRAPH-64</a><br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; If you can suggest a better approach, please add to the is=
sue or create<br>
&gt;&gt;&gt;&gt; a<br>
&gt;&gt;&gt;&gt; new one if appropriate.<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; Thanks,<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; Avery<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; On 11/5/11 4:11 AM, Gianmarco De Francisci Morales wrote:<=
br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;&gt; Hi community,<br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;&gt; I was wondering what is the current best practice to p=
ackage an<br>
&gt;&gt;&gt;&gt;&gt; application in a jar for deployment.<br>
&gt;&gt;&gt;&gt;&gt; I tried the &#39;hadoop way&#39; by putting giraph-*.j=
ar in the /lib directory<br>
&gt;&gt;&gt;&gt;&gt; of<br>
&gt;&gt;&gt;&gt;&gt; my jar, and using the -libjars option but none of them=
 worked. It looks<br>
&gt;&gt;&gt;&gt;&gt; like<br>
&gt;&gt;&gt;&gt;&gt; the backend classloader is doing some mess and it does=
n&#39;t find my own<br>
&gt;&gt;&gt;&gt;&gt; classes in the jar.<br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;&gt; I resorted to uncompressing the giraph-*.jar and repac=
kaging my classes<br>
&gt;&gt;&gt;&gt;&gt; with it, all at the same level (an uber-fat jar), but =
even though it<br>
&gt;&gt;&gt;&gt;&gt; works<br>
&gt;&gt;&gt;&gt;&gt; it doesn&#39;t sound like the right approach.<br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;&gt; Any suggestions?<br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;&gt; Thanks,<br>
&gt;&gt;&gt;&gt;&gt; --<br>
&gt;&gt;&gt;&gt;&gt; Gianmarco<br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; --<br>
&gt;&gt;&gt; =A0 =A0 Claudio Martella<br>
&gt;&gt;&gt; =A0 =A0 <a href=3D"mailto:claudio.martella@gmail.com">claudio.=
martella@gmail.com</a><br>
&gt;&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;<br>
&gt;<br>
<br>
<br>
<br>
</div></div><font color=3D"#888888">--<br>
=A0 =A0 Claudio Martella<br>
=A0 =A0 <a href=3D"mailto:claudio.martella@gmail.com">claudio.martella@gmai=
l.com</a><br>
</font></blockquote></div><br></div>

--0016364d1e7d4f8a4404b1631ad9--