incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (HAMA-258) Design a input and output system
Date Tue, 12 Apr 2011 15:11:05 GMT

    [ https://issues.apache.org/jira/browse/HAMA-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13018842#comment-13018842
] 

Edward J. Yoon edited comment on HAMA-258 at 4/12/11 3:10 PM:
--------------------------------------------------------------

{code}
    public void bsp(BSPPeerProtocol bspPeer) throws Exception {

        // Send initial messages to each peers.
        File input = File.open(“graph.dat”);
        int i = 0;
        for (String peerName : cluster.getActiveGroomNames().values()) {
           Map<K, V> subSet = input.getSubset(i);
           for(Map.Entry<K, V> entry : subSet.entrySet()) {
             ...
             bspPeer.send(peerName, new BSPMessage(Tag, Data));
           }
           i++;
        }
        bspPeer.sync();
   
        …..
    }
{code}

This is very rough idea. I think, we can broadcast initial messages to each peers like above
code.

Unlike MapReduce system, we can assign the data to each tasks flexibly.

      was (Author: udanax):
    {code}
    public void bsp(BSPPeerProtocol bspPeer) throws Exception {

        // Send initial messages to each peers.
        Table input = table.open(“graph”);
        int i = 0;
        for (String peerName : cluster.getActiveGroomNames().values()) {
           Map<K, V> subSet = input.getSubset(i);
           for(Map.Entry<K, V> entry : subSet.entrySet()) {
             ...
             bspPeer.send(peerName, new BSPMessage(Tag, Data));
           }
           i++;
        }
        bspPeer.sync();
   
        …..
    }
{code}

This is very rough idea. I think, we can broadcast initial messages to each peers like above
code.

Unlike MapReduce system, we can assign the data to each tasks flexibly.
  
> Design a input and output system
> --------------------------------
>
>                 Key: HAMA-258
>                 URL: https://issues.apache.org/jira/browse/HAMA-258
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp
>    Affects Versions: 0.3.0
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.3.0
>
>
> This issue will handle the input and output system with data splitter.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message