helix-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kanak Biscuitwala (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HELIX-141) Autorebalance does not work reliably and fails when replica>1
Date Fri, 26 Jul 2013 18:45:48 GMT

     [ https://issues.apache.org/jira/browse/HELIX-141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Kanak Biscuitwala updated HELIX-141:

    Attachment: 0001-HELIX-141-Auto-rebalancer-that-works-for-arbitrary-p.patch

Attaching the fix. Code review: https://reviews.apache.org/r/12955/
> Autorebalance does not work reliably and fails when replica>1
> -------------------------------------------------------------
>                 Key: HELIX-141
>                 URL: https://issues.apache.org/jira/browse/HELIX-141
>             Project: Apache Helix
>          Issue Type: Bug
>            Reporter: kishore gopalakrishna
>            Assignee: Kanak Biscuitwala
>         Attachments: 0001-HELIX-141-Auto-rebalancer-that-works-for-arbitrary-p.patch
> Autorebalance has a bug in calculating the assignment of partitions to nodes. It does
not consider the fact that  a partition can have replicas. This was not tested because we
generally use 1 replica ( consumer grouping). 
> As we are doing this, we might want to fix/add the following features
> #1. Allow user to set a minimum number of nodes to be up before computing the assignment.
This minimizes the number of re-assignments when nodes start up.
> #2. Have the concept of preferred node for a partition,replica. Which means when ever
a partition,replica is orphaned try to first place it on its preferred location. Preferred
location can be something like (p+r)%N. This will require us to use the total number of nodes
to compute the preferred location. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message