giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-785) Improve GraphPartitionerFactory usage
Date Wed, 08 Jan 2014 20:10:50 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865829#comment-13865829
] 

Hudson commented on GIRAPH-785:
-------------------------------

FAILURE: Integrated in Giraph-trunk-Commit #1379 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1379/])
GIRAPH-785: Improve GraphPartitionerFactory usage (ikabiljo via majakabiljo) (majakabiljo:
http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=cdb49fd5f76027a4a66930e6b266ba79266c9852)
* giraph-core/src/main/java/org/apache/giraph/partition/RangePartitionerFactory.java
* giraph-core/src/main/java/org/apache/giraph/partition/SimplePartitionerFactory.java
* giraph-core/src/main/java/org/apache/giraph/partition/SimpleMasterPartitioner.java
* giraph-core/src/main/java/org/apache/giraph/partition/RangePartitionStats.java
* giraph-core/src/main/java/org/apache/giraph/partition/SimpleWorkerPartitioner.java
* giraph-core/src/main/java/org/apache/giraph/partition/SimpleRangeWorkerPartitioner.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/partition/SimpleLongRangePartitionerFactory.java
* giraph-core/src/main/java/org/apache/giraph/partition/RangeWorkerPartitioner.java
* giraph-core/src/main/java/org/apache/giraph/partition/RangePartitionOwner.java
* giraph-core/src/main/java/org/apache/giraph/partition/SimpleRangeMasterPartitioner.java
* giraph-core/src/main/java/org/apache/giraph/partition/PartitionUtils.java
* giraph-core/src/main/java/org/apache/giraph/partition/RangeMasterPartitioner.java
* giraph-core/src/main/java/org/apache/giraph/partition/SimpleIntRangePartitionerFactory.java
* giraph-core/src/test/java/org/apache/giraph/partition/SimpleRangePartitionFactoryTest.java
* giraph-core/src/main/java/org/apache/giraph/partition/RangeSplitHint.java


> Improve GraphPartitionerFactory usage 
> --------------------------------------
>
>                 Key: GIRAPH-785
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-785
>             Project: Giraph
>          Issue Type: Improvement
>          Components: graph
>    Affects Versions: 1.1.0
>            Reporter: Igor Kabiljo
>            Priority: Minor
>         Attachments: partition_patch.txt, partition_patch2.txt
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Usage of GraphPartitionerFactory can be improved:
> - defining custom partitioner needs extending 3 classes/interfaces, and defining multiple
functions, which is more complex than needed 
> - range partitioners are randomly assigning excess, instead of having each partition/worker
having 1 consecutive range
> - if maxPartitions is reached, we might be creating number of partitions that is not
divisible with number of workers



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message