giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maja Kabiljo" <majakabi...@fb.com>
Subject Review Request: GIRAPH-508: Increase the limit on the number of partitions
Date Fri, 08 Feb 2013 00:29:41 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/9370/
-----------------------------------------------------------

Review request for giraph.


Description
-------

Make more compact serialization for PartitionOwners, so we could increase the limit for the
total number of partitions.


This addresses bug GIRAPH-508.
    https://issues.apache.org/jira/browse/GIRAPH-508


Diffs
-----

  giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java 9ca1e7e 
  giraph-core/src/main/java/org/apache/giraph/graph/AddressesAndPartitionsWritable.java 990b04e

  giraph-core/src/main/java/org/apache/giraph/partition/BasicPartitionOwner.java c1df04b 
  giraph-core/src/main/java/org/apache/giraph/partition/HashMasterPartitioner.java fc56216

  giraph-core/src/main/java/org/apache/giraph/partition/PartitionOwner.java a886d79 
  giraph-core/src/main/java/org/apache/giraph/partition/RangePartitionOwner.java 1ecedb8 

Diff: https://reviews.apache.org/r/9370/diff/


Testing
-------

Run on real application with 200 workers and 40k partitions
mvn clean verify


Thanks,

Maja Kabiljo


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message