Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hama-dev@incubator.apache.org
Date: Wed, 7 Sep 2011 07:59:10 +0000 (UTC)
From: "Thomas Jungblut (JIRA)" <jira@apache.org>
To: hama-dev@incubator.apache.org
Message-ID: 
 <737718503.23972.1315382350692.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1068924829.6149.1314682357688.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Issue Comment Edited] (HAMA-431) MapReduce NG integration
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HAMA-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098675#comment-13098675 ] 

Thomas Jungblut edited comment on HAMA-431 at 9/7/11 7:57 AM:
--------------------------------------------------------------

Great so let's start with some kind of tutorial:

{noformat}
svn checkout http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23/
{noformat}

Follow the building rules in "BUILDING.txt".
Most of the time you'd just need to run:

{noformat}
mvn compile -e -DskipTests
{noformat}

This will retrieve the dependencies. 


If you don't have protobuf in your path, the build fails while compiling yarn-api. This is caused by the exec plugin which compiles the protobuf files (generates sources).

{noformat}

[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (generate-sources) on project hadoop-yarn-api: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (generate-sources) on project hadoop-yarn-api: Command execution failed.
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)

{noformat}

This pom.xml tries to run an executable called "protoc", so make sure you have installed protobuf correctly.
You can download it here: http://code.google.com/p/protobuf/

Follow the steps in INSTALL.txt. 
./configure
make
make install

Maybe "configure" fails because you don't have g++ installed, so just install it via "apt-get install g++" and then start the whole process again.
Be careful what the output of install says. For me it told me that he layed the shared objects into "/usr/local/lib". You then have to edit your "/etc/ld.so.conf" and add the path of the protobuf shared objects to it. Reload with "ldconfig".
Now you can try to run "protoc" on your shell, it should tell you "missing input file".

Back to yarn you can just call 

{noformat}
mvn compile -e -rf :hadoop-yarn-api -DskipTests
{noformat}

to rerun the build process.

      was (Author: thomas.jungblut):
    Great so let's start with some kind of tutorial:

{noformat}
svn checkout http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23/
{noformat}

Follow the building rules in "BUILDING.txt".
Most of the time you'd just need to run:

{noformat}
mvn compile -e -DskipTests
{noformat}

This will retrieve the dependencies. 

// to be extended
  
> MapReduce NG integration
> ------------------------
>
>                 Key: HAMA-431
>                 URL: https://issues.apache.org/jira/browse/HAMA-431
>             Project: Hama
>          Issue Type: New Feature
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>
> We should take a look at how to integrate Hama's BSP Engine to Hadoop's nextGen application platform.
> Can be currently found in the 0.23 branch.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira