hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-431) MapReduce NG integration
Date Fri, 14 Oct 2011 13:42:12 GMT

    [ https://issues.apache.org/jira/browse/HAMA-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127543#comment-13127543
] 

Thomas Jungblut commented on HAMA-431:
--------------------------------------

Great, branch is deleted and it is committed.

Next steps:
-fix TODOs
-integrate the SuperSteps in verbose mode of the YARNBSPJob (not working properly somehow)
-test Hama-YARN in fully distributed mode (check if configurations and jars are getting copied
correctly)
-add YARN serialize printing to examples package and make it dependend on YARN module.

Minor things:
-findbugs run, add target and .*files to SVN ignore.

Things to discuss:
*BSPPeer problems*
-Zookeeper yes/no/yes
-Checkpointing as a seperate process?
*general*
-module layout -> client/api/common/core yes/no/who wants to refactor this?

I'm going to create subtasks for the next steps and minor things. The discussion part must
be transfered to the mailing list.
                
> MapReduce NG integration
> ------------------------
>
>                 Key: HAMA-431
>                 URL: https://issues.apache.org/jira/browse/HAMA-431
>             Project: Hama
>          Issue Type: New Feature
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>         Attachments: WelcomeOnYarn.png, YARN_trunk_integration.patch, YARN_trunk_integration_v2.patch,
YARN_trunk_integration_v3.patch, job_state.dot, task_phase.dot, task_state.dot
>
>
> We should take a look at how to integrate Hama's BSP Engine to Hadoop's nextGen application
platform.
> Can be currently found in the 0.23 branch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message