giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-752) Better support for supernodes
Date Tue, 03 Sep 2013 18:17:52 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13756860#comment-13756860
] 

Hudson commented on GIRAPH-752:
-------------------------------

FAILURE: Integrated in Giraph-trunk-Commit #1281 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1281/])
GIRAPH-752: Better support for supernodes (majakabiljo) (majakabiljo: http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=96968fdcadb1f87017c6e7853c4a63ba065c6611)
* giraph-core/src/main/java/org/apache/giraph/utils/RepresentativeByteArrayIterator.java
* giraph-core/src/main/java/org/apache/giraph/utils/io/BigDataInput.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java
* giraph-core/src/main/java/org/apache/giraph/utils/io/BigDataOutput.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/out_of_core/PartitionDiskBackedMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayVertexIdMessages.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/LongByteArrayMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/out_of_core/SequentialFileMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/utils/io/ExtendedDataInputOutput.java
* giraph-core/src/main/java/org/apache/giraph/utils/io/DataInputOutput.java
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayIterator.java
* giraph-core/src/main/java/org/apache/giraph/utils/Factory.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/ByteArrayMessagesPerVertexStore.java
* giraph-core/src/main/java/org/apache/giraph/utils/io/package-info.java
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayIterable.java
* giraph-core/src/main/java/org/apache/giraph/utils/io/BigDataInputOutput.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/MessagesIterable.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/IntByteArrayMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/conf/ImmutableClassesGiraphConfiguration.java
* giraph-core/src/main/java/org/apache/giraph/utils/RepresentativeByteArrayIterable.java

                
> Better support for supernodes
> -----------------------------
>
>                 Key: GIRAPH-752
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-752
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Maja Kabiljo
>            Assignee: Maja Kabiljo
>         Attachments: GIRAPH-752.patch
>
>
> We've seen before that we crash when we have a vertex which receives a lot of messages
and we don't use a combiner. That is because the total size of serialized messages for that
vertex is bigger than the allowed size of an array. 
> We should implement OutputStream which can handle arbitrary size of data and add an option
to use that kind of stream for messages.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message