Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 4AA2C200BB1 for ; Thu, 3 Nov 2016 09:41:30 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 49426160AFF; Thu, 3 Nov 2016 08:41:30 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2D6A5160AFE for ; Thu, 3 Nov 2016 09:41:29 +0100 (CET) Received: (qmail 68118 invoked by uid 500); 3 Nov 2016 08:41:27 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 68108 invoked by uid 99); 3 Nov 2016 08:41:27 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Nov 2016 08:41:27 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 3D93218030C for ; Thu, 3 Nov 2016 08:41:27 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.279 X-Spam-Level: * X-Spam-Status: No, score=1.279 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=zalando-de.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id GfK0inG_7208 for ; Thu, 3 Nov 2016 08:41:24 +0000 (UTC) Received: from mail-qt0-f175.google.com (mail-qt0-f175.google.com [209.85.216.175]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 323935F3F4 for ; Thu, 3 Nov 2016 08:41:24 +0000 (UTC) Received: by mail-qt0-f175.google.com with SMTP id p16so23816569qta.0 for ; Thu, 03 Nov 2016 01:41:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zalando-de.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=5bD9+C36XGeuhHfkHxBPhLTfv7Pa1AnQJn6aKOUOxcM=; b=ixKt8eH4XAXTeNTJVuyxlPfCQ0ZvWfOP0I1AGxRPWfMBaAqYOhuHfMclfLKAF4O0lw VU9te0CYw2V0411pS1Np0/KgI2HQ9hy/FLB6w41N8dihfApXruk2p5Wn8HCCIkwNaA2W rkGc+vGcB2zigdVZjfxWjCy+XBYdLKW4uqqaIPqjXeOE4wJoOip+FlJds57rVZK6CBFK MPhZ761z7srKa9Hz8L+jftJgP8nErOEyqNSjyv7p0PQ0XeUCdtKcLTw/Z5O0dPvWTt/z wEaPxMfvgAO1d5cMTBtgwszKDLxwZfV73n5y88GeSebx8hh51sYt9ngBbTNoiFmknFqi xepg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=5bD9+C36XGeuhHfkHxBPhLTfv7Pa1AnQJn6aKOUOxcM=; b=gW7xbe2VNiJ4NcKgKu8pGA8iAToNRrPhVhI2UcKL2Q16xlNCNS5X05PHybC103N023 Mxk96ECgWfG3h01uVub446XtpUrL1NJZq4zqT/MU+eLyw+N8KjseZ5QKqXRYAWeTIXAj HSTyjXS69z7rTjkjlK+Ujytp6w2l+3T4RcUKrgqRArceDbSqLG3mJL3cKfZKD5xhMT7n p64PEeSk65ls1NrYSq6Ag9xb6GK+owBbU0RDZm3gSZojwxPNA/vjqCgKWBiHFZQCzHSD 5EICoTWP565xms6EzBqz7vGK67VhKLvnOxTxes0yh4JdXp9OQbwSVSiPqOKnPfUTHkoG /fCw== X-Gm-Message-State: ABUngvfL9OTaxrnhaXpqNOsPmSCZVB2rbcwODzEuVEZqtMlmtXmpFx136ydrDOD8Phqf9rq+eZ1JBFa0pT/zMYXV X-Received: by 10.200.36.246 with SMTP id t51mr6804334qtt.125.1478162474896; Thu, 03 Nov 2016 01:41:14 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.163.131 with HTTP; Thu, 3 Nov 2016 01:40:44 -0700 (PDT) In-Reply-To: References: From: Oleksandr Shulgin Date: Thu, 3 Nov 2016 09:40:44 +0100 Message-ID: Subject: Re: Rebuilding with vnodes To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a113744a63cb53205406185dd archived-at: Thu, 03 Nov 2016 08:41:30 -0000 --001a113744a63cb53205406185dd Content-Type: text/plain; charset=UTF-8 On Wed, Nov 2, 2016 at 8:59 PM, Anubhav Kale wrote: > Hello, > > > > I am trying to rebuild a new Data Center with 50 Nodes, and expect 1 TB / > node. Nodes are backed by SSDs, and the rebuild is happening from another > DC in same physical region. This is with 2.1.13. > > > > I am doing this with stream_throughput=200 MB, > concurrent_compactors=256, compactionthroughput=0, > Hi, How many CPU cores do you have per node? In my experience unthrottled compaction is CPU bound, but I never tried to raise the concurrency higher than the number of core a node has. How many actual concurrent compactions can you see from nodetool compactionstats? -- Alex --001a113744a63cb53205406185dd Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
On W= ed, Nov 2, 2016 at 8:59 PM, Anubhav Kale <Anubhav.Kale@microsoft.= com> wrote:

Hello,

=C2=A0

I am trying to rebuild a new Data Center with 50 Nod= es, and expect 1 TB / node. Nodes are backed by SSDs, and the rebuild is ha= ppening from another DC in same physical region. This is with 2.1.13.

=C2=A0

I am doing this with stream_throughput=3D200 MB,

=

concurrent_compactors=3D256, compact= ionthroughput=3D0,


Hi,

How many CPU cores do you have per node?=C2=A0 In my e= xperience unthrottled compaction is CPU bound, but I never tried to raise t= he concurrency higher than the number of core a node has.

How many actual concurrent compactions can you see from nodetool co= mpactionstats?

--
Alex

--001a113744a63cb53205406185dd--