giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alessandro Presta (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GIRAPH-224) Server-side combiner
Date Tue, 03 Jul 2012 18:16:20 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alessandro Presta updated GIRAPH-224:
-------------------------------------

    Attachment: GIRAPH-224-2.patch

Combining messages in SendPartitionMessagesRequest#doRequest().
I'm doing this in the synchronized block, combining all existing messages with the ones in
the request.

Here's how I tested it:
- added a MinimumDoubleCombiner to the simple shortest paths example
- disabled combining on the client side (SendMessageCache)
- logged the number of messages received by every vertex
- verified that it's always 0 or 1
                
> Server-side combiner
> --------------------
>
>                 Key: GIRAPH-224
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-224
>             Project: Giraph
>          Issue Type: Improvement
>          Components: bsp
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>         Attachments: GIRAPH-224-1.patch, GIRAPH-224-2.patch, GIRAPH-224.patch
>
>
> Currently, if a VertexCombiner is defined in the Configuration, we use it on the client
in order to optimize bandwidth and memory usage.
> On the server side, we can easily benefit in terms of memory by exploiting the combiner
once more.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message