Return-Path: X-Original-To: apmail-giraph-dev-archive@www.apache.org Delivered-To: apmail-giraph-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AAC7AE594 for ; Fri, 22 Feb 2013 18:26:13 +0000 (UTC) Received: (qmail 21195 invoked by uid 500); 22 Feb 2013 18:26:13 -0000 Delivered-To: apmail-giraph-dev-archive@giraph.apache.org Received: (qmail 21147 invoked by uid 500); 22 Feb 2013 18:26:13 -0000 Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@giraph.apache.org Delivered-To: mailing list dev@giraph.apache.org Received: (qmail 21066 invoked by uid 500); 22 Feb 2013 18:26:13 -0000 Delivered-To: apmail-incubator-giraph-dev@incubator.apache.org Received: (qmail 21004 invoked by uid 99); 22 Feb 2013 18:26:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Feb 2013 18:26:13 +0000 Date: Fri, 22 Feb 2013 18:26:13 +0000 (UTC) From: "Alessandro Presta (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (GIRAPH-535) Range-partitioning and edge locality benchmark MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GIRAPH-535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13584509#comment-13584509 ] Alessandro Presta commented on GIRAPH-535: ------------------------------------------ https://reviews.apache.org/r/9562/ > Range-partitioning and edge locality benchmark > ---------------------------------------------- > > Key: GIRAPH-535 > URL: https://issues.apache.org/jira/browse/GIRAPH-535 > Project: Giraph > Issue Type: New Feature > Reporter: Alessandro Presta > Assignee: Alessandro Presta > Attachments: GIRAPH-535.patch > > > Range-based partitioning can drastically reduce network communication when using a vertex id space where close ids correspond to vertices likely to be connected. > We currently have an incomplete implementation of range-based partitioning that tries to be very generic (allowing arbitrarily different partition sizes). > Talking about this with Avery, we thought that for now it's better to add a simpler version (which tries to split as evenly as possible) and leave the current classes there in case someone wants to implement a more complex logic. > A nice-to-have is also extending the pseudo-random formats to generate a required ratio of partition-local edges, in order to estimate the impact of locality with benchmarks. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira