giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Edunov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-927) Decouple netty server threads from message processing
Date Tue, 22 Jul 2014 16:58:39 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14070509#comment-14070509
] 

Sergey Edunov commented on GIRAPH-927:
--------------------------------------

Yep, indeed, I'll be working on fix. 

> Decouple netty server threads from message processing
> -----------------------------------------------------
>
>                 Key: GIRAPH-927
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-927
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Sergey Edunov
>         Attachments: GIRAPH-927.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Our profiling shows that a lot of apps are neither CPU nor memory or network bound. Instead
they waste a lot of time waiting for lock in MessageStore. That happens in netty threads.

> We should be able to put messages into queue and then process them in other set of threads.

> It has to be configurable because adding another thread level will introduce additional
overhead. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message