hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ChiaHung Lin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-431) MapReduce NG integration
Date Tue, 13 Sep 2011 06:06:09 GMT

    [ https://issues.apache.org/jira/browse/HAMA-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103389#comment-13103389

ChiaHung Lin commented on HAMA-431:

Some thoughts base what I have known so far, but I may be wrong (or miss the point) and probably
do not see the whole forest. 

Each BSPPeer could periodically poll the AM if it can proceed to the next superstep. ...
With polling, it seems that chances are the polling would not reach the agreement (there could
always have 1 process missing) in an unfortunate timing case. Also, as the  processes increase
probably it would increase the loading for master to deal with polling tasks. 

In addition, my understanding is the integration with MRV2 would be just an additional support
so that MR job/ application can be submitted without rewriting to use hama for computation.

> MapReduce NG integration
> ------------------------
>                 Key: HAMA-431
>                 URL: https://issues.apache.org/jira/browse/HAMA-431
>             Project: Hama
>          Issue Type: New Feature
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
> We should take a look at how to integrate Hama's BSP Engine to Hadoop's nextGen application
> Can be currently found in the 0.23 branch.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message