incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-515) Counter should be synchronized by sync()
Date Mon, 23 Apr 2012 18:10:34 GMT

    [ https://issues.apache.org/jira/browse/HAMA-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13259789#comment-13259789
] 

Thomas Jungblut commented on HAMA-515:
--------------------------------------

Can someone assist me here? It is a totally brainfuck task.
We should have done this correctly right at the start when we introduced them... And I'm currently
in a stage of writing it again from scratch just maintaining the API.

However I feel it is very ugly to serialize and deserialize all the counter in every superstep
and put it into ZK.  
                
> Counter should be synchronized by sync()
> ----------------------------------------
>
>                 Key: HAMA-515
>                 URL: https://issues.apache.org/jira/browse/HAMA-515
>             Project: Hama
>          Issue Type: New Feature
>    Affects Versions: 0.5.0
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>            Priority: Minor
>             Fix For: 0.6.0
>
>         Attachments: HAMA-515.patch
>
>
> We should synchronize the counters in all tasks after a sync() call. 
> Then someone can use it for flow control. E.G. graph related algorithms, to get the number
of globally updated vertices.
> Two options to solve this:
>  - Sync the whole stuff over RPC from the BSPMaster
>  - Use Zookeeper for counter handling

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message