Mailing-List: contact giraph-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: giraph-dev@incubator.apache.org
Date: Tue, 15 Nov 2011 20:48:54 +0000 (UTC)
From: "Jakob Homan (Commented) (JIRA)" <jira@apache.org>
To: giraph-dev@incubator.apache.org
Message-ID: 
 <1166063776.32393.1321390134784.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <368307290.14724.1317459705764.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (GIRAPH-45) Improve the way to keep outgoing
 messages
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/GIRAPH-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150757#comment-13150757 ] 

Jakob Homan commented on GIRAPH-45:
-----------------------------------

bq. I'm not sure whether sending messages in a streamy way would actually diminish any kind of memory pressure.
Right. As above, the total amount of bytes that would have to be stored *somewhere* would be the same (absent any advantage we get from having more combine-able messages in one place to be combined).  We'd be potentially saving (very slow) disk bandwidth by putting them on the network immediately where, depending on the destination's memory situation, it may or may not make sense to spill to disk, to combine, etc.
                
> Improve the way to keep outgoing messages
> -----------------------------------------
>
>                 Key: GIRAPH-45
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-45
>             Project: Giraph
>          Issue Type: Improvement
>          Components: bsp
>            Reporter: Hyunsik Choi
>            Assignee: Hyunsik Choi
>
> As discussed in GIRAPH-12(http://goo.gl/CE32U), I think that there is a potential problem to cause out of memory when the rate of message generation is higher than the rate of message flush (or network bandwidth).
> To overcome this problem, we need more eager strategy for message flushing or some approach to spill messages into disk.
> The below link is Dmitriy's suggestion.
> https://issues.apache.org/jira/browse/GIRAPH-12?focusedCommentId=13116253&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13116253

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira