giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexandre Fonseca (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-798) Upgrade Giraph to Java7 and fix all dependencies
Date Wed, 11 Dec 2013 10:25:07 GMT


Alexandre Fonseca commented on GIRAPH-798:

Not very familiar with maven but the attached patches GIRAPH-ZOOKEEPER34 and GIRAPH-YARN-COMPILE
allowed me to compile the giraph-core and giraph-examples under the pure hadoop_yarn profile
with the latest trunk.

GIRAPH-ZOOKEPER34 removes ZooKeeper 3.2/3 specific code that prevented it from compiling with
3.4 and should introduce no problems in previous versions.

GIRAPH-YARN-COMPILE is a bit hackish and so should not be included directly. I just forced
the expected package versions when using the hadoop_yarn profile. I also noted that, while
in the previous versions of the poms, a mvn compile would skip the dependency checking in
giraph-dist (which fails due to the non compilation of accumulo,hbase,hcatalog, etc), with
the new poms this doesn't happen (although there is no change in giraph-dist/pom.xml). I expect
this is because of the dependency enforcer/checker plugins. Thus, to enable at least correct
compilation of the core and examples package, I disabled the compilation of giraph-dist.

With these changes, I was able to compile using the following command without getting any
of the version conflicts reported in GIRAPH-804 and others:
{code}mvn -Phadoop_yarn -Dhadoop.version=2.2.0 -DskipTests compile{code}

And to run the SimpleShortestPaths examples (with some other patches of other issues non-related
to this one and specific to yarn).

Hope these patches can be of help in your endeavour Avery.

> Upgrade Giraph to Java7 and fix all dependencies
> ------------------------------------------------
>                 Key: GIRAPH-798
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Avery Ching
>            Assignee: Avery Ching
> We need to upgrade to Java 7, Java 6 is no longer supported and Java 7 provides a lot
of great new features.
> Additionally, we have a mess of dependencies.
> Incompatible versions, unspecified dependencies, and duplicate classes.  We will add
checks for all of them.
> For now, full checks are provided for the profiles
> hadoop_0.20.203
> hadoop_1.0
> hadoop_facebook
> Also, the hcatalog module is not fully fixed and excluded from the checking.  We can
fix this in the future.

This message was sent by Atlassian JIRA

View raw message