Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1987A200C01 for ; Thu, 5 Jan 2017 07:22:38 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 181C7160B44; Thu, 5 Jan 2017 06:22:38 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3A8BD160B3A for ; Thu, 5 Jan 2017 07:22:37 +0100 (CET) Received: (qmail 87839 invoked by uid 500); 5 Jan 2017 06:22:35 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 87825 invoked by uid 99); 5 Jan 2017 06:22:35 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Jan 2017 06:22:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 1B14DC046F for ; Thu, 5 Jan 2017 06:22:35 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.479 X-Spam-Level: ** X-Spam-Status: No, score=2.479 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=zalando-de.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Qxi-BU1rx-Iz for ; Thu, 5 Jan 2017 06:22:32 +0000 (UTC) Received: from mail-qk0-f169.google.com (mail-qk0-f169.google.com [209.85.220.169]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 9ED045FD36 for ; Thu, 5 Jan 2017 06:22:32 +0000 (UTC) Received: by mail-qk0-f169.google.com with SMTP id n21so423841988qka.3 for ; Wed, 04 Jan 2017 22:22:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zalando-de.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=9U4lAbLVOosJ80Zba7eS7p+PaqwZsH7orJEpYXfCYMs=; b=NJTh3gPUB+GKeBt+n5eP/TBcAyRU44ksvjbzXTcwO7OIV0EM9CR49cMeCouE8v1XhF S8yIwvT71hrQAY05s82PKr2Bkh+rF16oBWT+qCxY3fCEGVBVhlL3pM9T+oC8DXXuKFVF RW0QtBJuavwme5fI46UG2FVNfeI4xPOw3z1k6tMUMZKB9hncDtGcEWOqC/FNBZ/Ks1vS 2YiTIXevvhLHVt8M8VNOkyX6417bdThUJCXYeFRqZpwf9NJpKfsOhQNOUfvfPxfRbHAY U1DdVtr9EP6yn86WrJ1RxKFM5lvqjdlxKSr4aINUQ7BZb363tGi9m40V7+g5SCKWvvqH qEHg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=9U4lAbLVOosJ80Zba7eS7p+PaqwZsH7orJEpYXfCYMs=; b=LswhJeejTAozBLlFi7ffkBDzfIG7aKd05GwfFqXd1Tqws9o//jkLQ4+y1mNgea1ABJ tQ1p3CbapUZN/lh/eIoWtG2aLwgXND9cOqZwX9XGjCUMYUSFvUVdEQZ9hIvXoYz6ddYz /b4ID+zQtX+C9s74WRYUhmWCccTkdU7Yp2pLVpqk644DijldT5JBwOhVtppehqlEElf/ 30IFQfbhDvM3tYvxAZx05G95+ktfs/bwArC+SsQYlxgsURCTV9fV7iWu9fgJpH5z0PQM UQNMhLFqqnLJyH/Vlklgq/OJpgUqOOx2EvPyq75L1mpQHso2H4V2nYGH2dw/qUDYIxbI sZ2A== X-Gm-Message-State: AIkVDXKXRFdo9mmXVroJO13v5VBEU5Cnfw/FrnBSM3bv6qx1GTwijLgQY3cj5u9eyX7x8PLUoTzZft+CY4P6Dlt3 X-Received: by 10.55.140.194 with SMTP id o185mr4204749qkd.50.1483597349261; Wed, 04 Jan 2017 22:22:29 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.157.7 with HTTP; Wed, 4 Jan 2017 22:22:28 -0800 (PST) Received: by 10.12.157.7 with HTTP; Wed, 4 Jan 2017 22:22:28 -0800 (PST) In-Reply-To: References: From: Oleksandr Shulgin Date: Thu, 5 Jan 2017 07:22:28 +0100 Message-ID: Subject: Re: Why compacting process uses more data that is expected To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a114f7576fe3d30054552ec48 archived-at: Thu, 05 Jan 2017 06:22:38 -0000 --001a114f7576fe3d30054552ec48 Content-Type: text/plain; charset=UTF-8 On Jan 4, 2017 17:58, "Jean Carlo" wrote: Hello guys I have a table with 34Gb of data in sstables (including tmp). And I can see cassandra is doing some compactions on it. What surprissed me is that nodetool compactionstats says he is compacting 138.66GB root@node001 /root # nodetool compactionstats -H pending tasks: 103 * compaction type keyspace table completed total unit progress* Compaction keyspace1 table_02 112.74 GB 138.66 GB bytes 81.31% Active compaction remaining time : 0h03m27s So My question is, from where those 138.66GB come if my table has only 34GB of data. Hello, I believe that output of compactionstats shows you the size of *uncompressed* data. Can you check (with nodetool tablestats) your compression ratio? -- Alex --001a114f7576fe3d30054552ec48 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
On Jan 4, 2017 17:58, "Jean Carlo" <jean.jeancarl48@gmail.com> wrote:
Hello guys

I have a table= with 34Gb of data in sstables (including tmp). And I can see cassandra is = doing some compactions on it. What surprissed me is that nodetool compactio= nstats says he is compacting=C2=A0 138.66GB


root@n= ode001 /root # nodetool compactionstats -H
pending tasks: 103
=C2= =A0=C2=A0 compaction type=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 keyspac= e=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 table=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 completed=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 total=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 unit= =C2=A0=C2=A0 progress
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Com= paction=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 keyspace1 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 tab= le_02=C2=A0=C2=A0 112.74 GB=C2=A0=C2=A0 138.66 GB=C2=A0=C2=A0 bytes=C2=A0= =C2=A0=C2=A0=C2=A0 81.31%
Active compaction remaining time :=C2=A0=C2=A0= 0h03m27s

So My quest= ion is, from where those 138.66GB come if my table has only 34GB of data.

Hello,

I believe that output of=C2=A0co= mpactionstats shows you the size of *uncompressed* data. Can you check (wit= h nodetool tablestats) your compression ratio?

<= /div>
--
Alex
--001a114f7576fe3d30054552ec48--