giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-1023) Adding out-of-core messages to the newly added adaptive out-of-core mechanism
Date Thu, 30 Jul 2015 21:33:05 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648344#comment-14648344
] 

Hudson commented on GIRAPH-1023:
--------------------------------

FAILURE: Integrated in Giraph-trunk-Commit #1563 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1563/])
[GIRAPH-1023] Adding out-of-core messages to previously implemented adaptive out-of-core mechanism
(aching: http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=6f5a457fa93ac8b53cc77afd0eb8729f1e5665af)
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendWorkerMessagesRequest.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/LongDoubleMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/IdByteArrayMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/graph/ComputeCallable.java
* giraph-core/src/main/java/org/apache/giraph/ooc/CheckMemoryCallable.java
* giraph-core/src/test/java/org/apache/giraph/comm/RequestFailureTest.java
* giraph-core/src/main/java/org/apache/giraph/comm/ServerData.java
* giraph-core/src/main/java/org/apache/giraph/ooc/AdaptiveOutOfCoreEngine.java
* giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
* giraph-examples/src/test/java/org/apache/giraph/TestOutOfCore.java
* giraph-core/src/main/java/org/apache/giraph/comm/netty/NettyWorkerClientRequestProcessor.java
* giraph-core/src/main/java/org/apache/giraph/ooc/OutOfCoreProcessorCallable.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/SimpleMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/MessageData.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/IdOneMessagePerVertexStore.java
* giraph-core/src/main/java/org/apache/giraph/partition/SimplePartitionStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendPartitionCurrentMessagesRequest.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/ByteArrayMessagesPerVertexStore.java
* giraph-core/src/main/java/org/apache/giraph/partition/PartitionData.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/out_of_core/DiskBackedMessageStore.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/comm/netty/NettyWorkerServer.java
* giraph-core/src/test/java/org/apache/giraph/partition/TestPartitionStores.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/IntByteArrayMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/MessageStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/long_id/LongAbstractMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/partition/PartitionStore.java
* giraph-core/src/test/java/org/apache/giraph/comm/RequestTest.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/IntFloatMessageStore.java
* giraph-core/src/test/java/org/apache/giraph/utils/MockUtils.java
* giraph-core/src/test/java/org/apache/giraph/comm/messages/queue/AsyncMessageStoreWrapperTest.java
* giraph-core/src/main/java/org/apache/giraph/ooc/DiskBackedPartitionStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/queue/AsyncMessageStoreWrapper.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendWorkerOneMessageToManyRequest.java


> Adding out-of-core messages to the newly added adaptive out-of-core mechanism
> -----------------------------------------------------------------------------
>
>                 Key: GIRAPH-1023
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-1023
>             Project: Giraph
>          Issue Type: New Feature
>          Components: graph
>            Reporter: Hassan Eslami
>            Assignee: Hassan Eslami
>
> GIRAPH-1022 implements an adaptive mechanism for out-of-core capable of handling graph
data structure (in input/output and compute superstep). This diff, adds capability of handling
out-of-core messages as well. This is useful specially in the case where message combiner
is not used and large amount of messages may cause the job to either fail due to OOM (or its
related exceptions), or run with a very low performance due to extensive GC calls.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message