incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-431) MapReduce NG integration
Date Wed, 14 Sep 2011 11:57:09 GMT

    [ https://issues.apache.org/jira/browse/HAMA-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104437#comment-13104437
] 

Thomas Jungblut commented on HAMA-431:
--------------------------------------

Regarding the barrier sync:
My idea is that we have two RPC calls, enterBarrier() and leaveBarrier().
In the ApplicationMaster we can handle each superstep via a CyclicBarrier[1] on the number
of tasks. 
So the RPC call is going from the client container to the ApplicationMaster, this call is
going through the barrier, causing the clients to wait until the barrier is tripped. Then
the RPC call returns to the clients, they send their messages and the whole thing is repeated
with leaveBarrier(). 

In this case we don't have to poll for completion and it some higher level construct that
works (see LocalBSPRunner).

[1] http://download.oracle.com/javase/1,5.0/docs/api/java/util/concurrent/CyclicBarrier.html

> MapReduce NG integration
> ------------------------
>
>                 Key: HAMA-431
>                 URL: https://issues.apache.org/jira/browse/HAMA-431
>             Project: Hama
>          Issue Type: New Feature
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>
> We should take a look at how to integrate Hama's BSP Engine to Hadoop's nextGen application
platform.
> Can be currently found in the 0.23 branch.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message