giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-1002) Support better message config for Giraph
Date Fri, 10 Apr 2015 19:38:13 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14490227#comment-14490227
] 

Hudson commented on GIRAPH-1002:
--------------------------------

FAILURE: Integrated in Giraph-trunk-Commit #1531 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1531/])
[GIRAPH-1002] Improve message changing through iters (edunov: http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=5d0b81ac42ab0de80bb68b87c7d1c1dd710f1108)
* giraph-examples/src/test/java/org/apache/giraph/TestBspBasic.java
* giraph-core/src/main/java/org/apache/giraph/comm/SendMessageCache.java
* giraph-core/src/test/java/org/apache/giraph/comm/TestMessageStores.java
* giraph-core/src/main/java/org/apache/giraph/conf/ImmutableClassesGiraphConfiguration.java
* giraph-core/src/test/java/org/apache/giraph/master/TestSwitchClasses.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/out_of_core/SequentialFileMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/InMemoryMessageStoreFactory.java
* giraph-core/src/main/java/org/apache/giraph/utils/ReflectionUtils.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphClasses.java
* giraph-core/src/main/java/org/apache/giraph/jython/JythonOptions.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/primitives/IdOneMessagePerVertexStore.java
* giraph-hive/src/main/java/org/apache/giraph/hive/jython/HiveJythonUtils.java
* giraph-core/src/main/java/org/apache/giraph/factories/DefaultOutgoingMessageValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java
* giraph-core/src/main/java/org/apache/giraph/conf/PerGraphTypeBooleanConfOption.java
* giraph-core/src/main/java/org/apache/giraph/factories/AbstractMessageValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendPartitionCurrentMessagesRequest.java
* findbugs-exclude.xml
* giraph-core/src/main/java/org/apache/giraph/conf/DefaultMessageClasses.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/OneMessagePerVertexStore.java
* giraph-core/src/main/java/org/apache/giraph/master/SuperstepClasses.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphTypes.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/out_of_core/DiskBackedMessageStore.java
* giraph-core/src/test/java/org/apache/giraph/utils/TestReflectionUtils.java
* giraph-core/src/main/java/org/apache/giraph/master/MasterCompute.java
* giraph-core/src/main/java/org/apache/giraph/conf/PerGraphTypeBoolean.java
* giraph-core/src/main/java/org/apache/giraph/factories/DefaultIncomingMessageValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/conf/PerGraphTypeEnumConfOption.java
* giraph-core/src/main/java/org/apache/giraph/factories/DefaultVertexIdFactory.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/MessageStoreFactory.java
* giraph-core/src/main/java/org/apache/giraph/types/NoMessage.java
* giraph-core/src/main/java/org/apache/giraph/conf/MessageClasses.java
* giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java
* giraph-core/src/test/java/org/apache/giraph/conf/TestObjectCreation.java
* giraph-core/src/test/java/org/apache/giraph/master/TestComputationCombinerTypes.java
* giraph-core/src/main/java/org/apache/giraph/job/GiraphConfigurationValidator.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/out_of_core/DiskBackedMessageStoreFactory.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/comm/netty/NettyWorkerClientRequestProcessor.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/ByteArrayMessagesPerVertexStore.java
* giraph-core/src/main/java/org/apache/giraph/factories/TestMessageValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendWorkerMessagesRequest.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java
* giraph-core/src/main/java/org/apache/giraph/factories/ValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/comm/ServerData.java
* giraph-core/src/main/java/org/apache/giraph/jython/factories/JythonIncomingMessageValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/factories/DefaultVertexValueFactory.java
* giraph-core/src/test/java/org/apache/giraph/io/TestVertexEdgeInput.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendWorkerOneMessageToManyRequest.java
* giraph-core/src/main/java/org/apache/giraph/jython/factories/JythonFactoryBase.java
* giraph-core/src/main/java/org/apache/giraph/factories/ValueFactories.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/out_of_core/PartitionDiskBackedMessageStore.java
* giraph-core/src/main/java/org/apache/giraph/worker/InputSplitsCallable.java
* giraph-core/src/main/java/org/apache/giraph/factories/DefaultEdgeValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/factories/DefaultMessageValueFactory.java
* giraph-core/src/main/java/org/apache/giraph/jython/factories/JythonMessageValueFactory.java
* giraph-examples/src/test/java/org/apache/giraph/vertex/TestComputationTypes.java
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayVertexIdMessages.java
* giraph-core/src/main/java/org/apache/giraph/comm/SendOneMessageToManyCache.java
* giraph-core/src/main/java/org/apache/giraph/conf/PerGraphTypeEnum.java
* giraph-core/src/main/java/org/apache/giraph/graph/ComputeCallable.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/graph/GraphType.java


> Support better message config for Giraph
> ----------------------------------------
>
>                 Key: GIRAPH-1002
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-1002
>             Project: Giraph
>          Issue Type: Improvement
>          Components: graph
>            Reporter: Igor Kabiljo
>
> There are various different options for sending messages in Giraph:
> - whether there is going to be a combiner
> - MessageEncodeAndStoreType to be used
> - message factory
> - etc
> If you want different properties in different iterations, currently you can set some
of them in master through SuperstepClasses, which are then sent to all the workers, which
then use MessageStoreFactory (for example - InMemoryWithPrimitivesMessageStoreFactory)
> Some of the properties are missing there, and so cannot be changed at all (like message
factory/MessageEncodeAndStoreType)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message