giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Avery Ching (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-224) Server-side combiner
Date Mon, 02 Jul 2012 23:44:58 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405447#comment-13405447
] 

Avery Ching commented on GIRAPH-224:
------------------------------------

Alessandro, rather than do combining after the messages are all accumulated (already used
all our heap to store them), can you do it earlier?  Say in SendPartitionMessagesRequest?
 This will prevent the memory build up.
                
> Server-side combiner
> --------------------
>
>                 Key: GIRAPH-224
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-224
>             Project: Giraph
>          Issue Type: Improvement
>          Components: bsp
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>         Attachments: GIRAPH-224-1.patch, GIRAPH-224.patch
>
>
> Currently, if a VertexCombiner is defined in the Configuration, we use it on the client
in order to optimize bandwidth and memory usage.
> On the server side, we can easily benefit in terms of memory by exploiting the combiner
once more.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message