hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wolfgang hoschek (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-480) Try out different barrier implementations
Date Thu, 05 Apr 2012 16:50:26 GMT

    [ https://issues.apache.org/jira/browse/HAMA-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247359#comment-13247359
] 

wolfgang hoschek commented on HAMA-480:
---------------------------------------

Could also have a look at netflix's barrier implementation using zookeeper:

https://github.com/Netflix/curator/blob/master/curator-recipes/src/main/java/com/netflix/curator/framework/recipes/barriers/DistributedBarrier.java

https://github.com/Netflix/curator/blob/master/curator-recipes/src/main/java/com/netflix/curator/framework/recipes/barriers/DistributedDoubleBarrier.java

It would be great if Hama could demonstrate a barrier impl that has low latency and scales
to tens of thousands of peers. This would enable jobs with many short supersteps on large
clusters.
                
> Try out different barrier implementations
> -----------------------------------------
>
>                 Key: HAMA-480
>                 URL: https://issues.apache.org/jira/browse/HAMA-480
>             Project: Hama
>          Issue Type: Improvement
>            Reporter: Thomas Jungblut
>              Labels: bsp,, sync
>
> We should have a look at different barrier implementations with Zookeeper.
> Have a look at the goldenorb stuff for example:
> https://github.com/raveldata/goldenorb/blob/master/src/main/java/org/goldenorb/zookeeper/OrbFastBarrier.java
> With out new synchronization service class this should be easily testable.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message