giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-927) Decouple netty server threads from message processing
Date Sat, 19 Jul 2014 00:34:40 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067288#comment-14067288
] 

Hudson commented on GIRAPH-927:
-------------------------------

ABORTED: Integrated in Giraph-trunk-Commit #1469 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1469/])
GIRAPH-927: Decouple netty server threads from message processing (edunov via pavanka) (pavanka:
http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=969a488183a42dedbde8dcec7ac00595a836974c)
* giraph-core/src/main/java/org/apache/giraph/comm/ServerData.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/queue/package-info.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/InMemoryMessageStoreFactory.java
* giraph-examples/src/test/java/org/apache/giraph/TestCheckpointing.java
* giraph-core/src/test/java/org/apache/giraph/comm/messages/queue/AsyncMessageStoreWrapperTest.java
* giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/queue/PartitionMessage.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/queue/AsyncMessageStoreWrapper.java


> Decouple netty server threads from message processing
> -----------------------------------------------------
>
>                 Key: GIRAPH-927
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-927
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Sergey Edunov
>         Attachments: GIRAPH-927.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Our profiling shows that a lot of apps are neither CPU nor memory or network bound. Instead
they waste a lot of time waiting for lock in MessageStore. That happens in netty threads.

> We should be able to put messages into queue and then process them in other set of threads.

> It has to be configurable because adding another thread level will introduce additional
overhead. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message