incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (Commented) (JIRA)" <>
Subject [jira] [Commented] (HAMA-431) MapReduce NG integration
Date Tue, 11 Oct 2011 09:59:12 GMT


Thomas Jungblut commented on HAMA-431:

I have a problem launching the APP master.

I'm putting the classpath together via suggested code:

    // Assuming our classes or jars are available as local resources in the
    // working directory from which the command will be run, we need to append
    // "." to the path.
    // By default, all the hadoop specific classpaths will already be available
    // in $CLASSPATH, so we should be careful not to overwrite it.
    String classPathEnv = "$CLASSPATH:./*:";
    env.put("CLASSPATH", classPathEnv);

The app master gets started with following start command:

Start command: ${JAVA_HOME}/bin/java -cp $CLASSPATH:./*: org.apache.hama.bsp.BSPApplicationMaster
file:/home/thomasjungblut/Desktop/application_1318323647317_0012/job.xml 1><LOG_DIR>/stdout

Which is correct, assuming that $CLASSPATH has been set properly by YARN.

But I think that it is not:

11/10/11 11:37:03 INFO ipc.YarnRPC: Creating YarnRPC for org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/avro/ipc/Server
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(
        at org.apache.hadoop.yarn.ipc.YarnRPC.create(
        at org.apache.hama.bsp.BSPApplicationMaster.<init>(
        at org.apache.hama.bsp.BSPApplicationMaster.main(
Caused by: java.lang.ClassNotFoundException: org.apache.avro.ipc.Server
        at Method)
        at java.lang.ClassLoader.loadClass(
        at sun.misc.Launcher$AppClassLoader.loadClass(
        at java.lang.ClassLoader.loadClass(
        ... 5 more

Is there a suggestion on how to solve this?

FYI, I'm submitting the dummy job via "yarn/bin/yarn jar xyz.jar". The generated start command
contains all the jars that should be needed. So classpath should be set properly.
> MapReduce NG integration
> ------------------------
>                 Key: HAMA-431
>                 URL:
>             Project: Hama
>          Issue Type: New Feature
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>         Attachments:,,
> We should take a look at how to integrate Hama's BSP Engine to Hadoop's nextGen application
> Can be currently found in the 0.23 branch.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message