hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: Significant performance improvement idea of Graph package
Date Fri, 19 Sep 2014 08:58:57 GMT
NOTE: I just heard that 0.7.0-snapshot's graph shows 20~30%
performance improvement from Byungseok Min and Victor Lee. I think I
can improve more with HAMA-919.

On Mon, Sep 15, 2014 at 6:31 PM, Edward J. Yoon <edwardyoon@apache.org> wrote:
> Hello all,
>
> Originally, I was added outgoing message manager to reduce the
> bundling overheads and fix the logical bug[1] of combine() method of
> Pregel model. In fact, that bug was not able to be addressed unless
> Graph package has own "outgoing message manager" since it need to
> combine multiple messages to the same Vertex before sending.
>
> Like this, if we manage the messages per vertex within
> OutgoingVertexMessageManager, we don't need to use the Sorted message
> queue for graph anymore! (the reason of using the sorted message queue
> for graph job, was to avoid grouping messages of incoming queue which
> requires huge amount of memory[2]. I think our solution was wrong).
> Moreover, with this, I expect that we'll be able to use
> multi-threading for vertex computations.
>
> Thanks.
>
> 1. https://issues.apache.org/jira/browse/HAMA-857
> 2. https://issues.apache.org/jira/browse/HAMA-704
>
> --
> Best Regards, Edward J. Yoon
> CEO at DataSayer Co., Ltd.



-- 
Best Regards, Edward J. Yoon
CEO at DataSayer Co., Ltd.

Mime
View raw message