incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ChiaHung Lin (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-480) Try out different barrier implementations
Date Mon, 28 Nov 2011 05:24:40 GMT

    [ https://issues.apache.org/jira/browse/HAMA-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158184#comment-13158184
] 

ChiaHung Lin commented on HAMA-480:
-----------------------------------

{quote}
Can we "emulate" this tree structure by using znodes in different levels?
For example if we can make a znode for a job and in the next level are the groom names and
in the very next levels are the tasks
<pre>
root 
  / job 
     / groom_name_0
            / task0
            / task1
     / groom_name_1
            / task2
            / task3
</pre>
So we can simply sync on grooms in the tasks and they get notified once all grooms have sync'd
theirselfs.
It this the idea behind the tree based sync?
{quote}
There should have no problem to simulate the above tree structure, which is similar to our
implementation with double barrier, in zookeeper. For tree based barrier sync, it divides
processes into subgroup and then synchronize among each other. Taken into an example of 8
processes, ranging from p0 to p7. At first stage, p1 sends message to p0 for sync; p3 to p2;
p5 to p4; p7 to p6. At the seconds stage, p6 sends message to p4; p2 to p0. At the third stage,
p4 sends message to p0 for reaching the barrier and then reverses notifying for leaving the
barrier. 

                
> Try out different barrier implementations
> -----------------------------------------
>
>                 Key: HAMA-480
>                 URL: https://issues.apache.org/jira/browse/HAMA-480
>             Project: Hama
>          Issue Type: Improvement
>            Reporter: Thomas Jungblut
>              Labels: bsp,, sync
>
> We should have a look at different barrier implementations with Zookeeper.
> Have a look at the goldenorb stuff for example:
> https://github.com/raveldata/goldenorb/blob/master/src/main/java/org/goldenorb/zookeeper/OrbFastBarrier.java
> With out new synchronization service class this should be easily testable.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message