Return-Path: X-Original-To: apmail-cassandra-dev-archive@www.apache.org Delivered-To: apmail-cassandra-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A96B9997E for ; Sat, 17 Mar 2012 13:11:36 +0000 (UTC) Received: (qmail 66895 invoked by uid 500); 17 Mar 2012 13:11:35 -0000 Delivered-To: apmail-cassandra-dev-archive@cassandra.apache.org Received: (qmail 66869 invoked by uid 500); 17 Mar 2012 13:11:35 -0000 Mailing-List: contact dev-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list dev@cassandra.apache.org Received: (qmail 66856 invoked by uid 99); 17 Mar 2012 13:11:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 17 Mar 2012 13:11:35 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of soverton@acunu.com designates 209.85.214.44 as permitted sender) Received: from [209.85.214.44] (HELO mail-bk0-f44.google.com) (209.85.214.44) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 17 Mar 2012 13:10:47 +0000 Received: by bkuw5 with SMTP id w5so4058877bku.31 for ; Sat, 17 Mar 2012 06:10:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acunu.com; s=google; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=pddZLsYoOFup16nz4Z1876zySTucKzm7lTm7i9DKYno=; b=DKW6dzLQdnlDthQWx2HPuN9sGaISYExDWnaE9znBTkorxVHXLIVONkFmpGfn6qDnic RfrRpDPl+1WBkkt03eKZTsf1zhsm3Mfvyq8mk7b48xIIBUrRxTL6PfxRV4APMbABGC9/ 8R4VnqnXt3ZLYzZZt2Xb8VB+WwiNHmwAIMEVU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:content-type:x-gm-message-state; bh=pddZLsYoOFup16nz4Z1876zySTucKzm7lTm7i9DKYno=; b=C9xwtyfxG3g2sY2vQeBc1a82+rSQXSPTOi5xGGiShr18P35++Ez3swMFGtQXyqpaUC 3RAwwCjq0Xg3ClZ8YGn9xtUT98j3+AgR1JGCZy+PpS6EH70bFWxfroYCM2lmPCg1pDh9 vfyyiXFrpsNdCxJ5tCl1vM+8wlOsJqVoZxDvznKDuEmlRfR8/ggxDSF3D9LaVLkrx1IX Jj3ppmOrqO7DKesdVaFEk7vu76H1QXj7A2pBhT+r7EIrbf1N8wiDk3uB33AROlv4sEQT FZhOuSVOfATGlrjrpChKWL42+nkz2vN0f8LxIcGNaRZm/hxgI7xRSpKyBOXojFF5pXD5 Dz1w== MIME-Version: 1.0 Received: by 10.204.156.65 with SMTP id v1mr2176211bkw.109.1331989819182; Sat, 17 Mar 2012 06:10:19 -0700 (PDT) Reply-To: sam@acunu.com Received: by 10.204.188.14 with HTTP; Sat, 17 Mar 2012 06:10:19 -0700 (PDT) In-Reply-To: <4F647248.7030404@filez.com> References: <4F647248.7030404@filez.com> Date: Sat, 17 Mar 2012 13:10:19 +0000 Message-ID: Subject: Re: RFC: Cassandra Virtual Nodes From: Sam Overton To: dev@cassandra.apache.org Content-Type: multipart/alternative; boundary=0015175cb66e044dcc04bb700c69 X-Gm-Message-State: ALoCoQlyedb+klx/qhOMPHAut/gqX84GO9onTnjuIAvW44Z/Fy0k1l2tZTO0ZpBH6esLpVUCf6ca X-Virus-Checked: Checked by ClamAV on apache.org --0015175cb66e044dcc04bb700c69 Content-Type: text/plain; charset=ISO-8859-1 On 17 March 2012 11:15, Radim Kolar wrote: > I don't like that every node will have same portion of data. > > 1. We are using nodes with different HW sizes (number of disks) > 2. especially with ordered partitioner there tends to be hotspots and you > must assign smaller portion of data to nodes holding hotspots > Hi Radim, The number of virtual nodes for each host would be configurable by the user, in much the same way that initial_token is configurable now. A host taking a larger number of virtual nodes (tokens) would have proportionately more of the data. This is how we anticipate support for heterogeneity in cluster hardware. Sam -- Sam Overton Acunu | http://www.acunu.com | @acunu --0015175cb66e044dcc04bb700c69--