Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9393F200C33 for ; Sat, 25 Feb 2017 01:25:18 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 92304160B69; Sat, 25 Feb 2017 00:25:18 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DC4D1160B79 for ; Sat, 25 Feb 2017 01:25:17 +0100 (CET) Received: (qmail 27662 invoked by uid 500); 25 Feb 2017 00:25:16 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 27652 invoked by uid 99); 25 Feb 2017 00:25:16 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2017 00:25:16 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id EDB4218E169 for ; Sat, 25 Feb 2017 00:25:15 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.929 X-Spam-Level: * X-Spam-Status: No, score=1.929 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 0bEbVHfIdTLw for ; Sat, 25 Feb 2017 00:25:15 +0000 (UTC) Received: from mail-qt0-f180.google.com (mail-qt0-f180.google.com [209.85.216.180]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id D289E5F3F5 for ; Sat, 25 Feb 2017 00:25:14 +0000 (UTC) Received: by mail-qt0-f180.google.com with SMTP id n21so29598927qta.1 for ; Fri, 24 Feb 2017 16:25:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=JxUq4NILottk+2A989er3Zo2daiBn7n5LS4wOe5I4c4=; b=C+3Xh8cirX6uSNJeKNjizcwhU0zqXWowTsK9d4t9GtraMa/0mu3TUX8pnwBtmQg/H8 LICd5oLjL2qNJH7EtPlcpIW+7li6l20KdOgaJx2Bz+zwB102MO33P74Bx5aUo86NhxI8 eT0pA2veXD3ZS3jHyXY9jKCRv+9st80v53tLvlaUjEA4XfxIt7RxaiS4GDOCLaPrGwSU jAqhZIcG5ogPO81qvtc1D2yBHh9atJ4lPmF7hP1c2r7IPyJAeLqXg3x+E1pjh1jKThMm DBW6FMmiqiFAVo1+kCfryc1jjGoD27hc3+7MjVf/xdCBd9Bu56XtJWCrDaX4HvCFJ0yR 7TFw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=JxUq4NILottk+2A989er3Zo2daiBn7n5LS4wOe5I4c4=; b=ciaViB4hck6nSvkmlHznIFWNyL29WH8ComUxDAvH3tn4tA5vL4Ft9DbfxE4FakllHU FSdK7cGWF/9V8YUr5swZTZYPYbwlUUpLMp1XIfCZb1LSKoP94JS+8W3eVD3fayzHJqYt i8Sqvcs2vCbaqpQeASYJBJF/I4RGtMYdEtYRxsk4l4blAW4q7csfeLI6aCvOK91QnSaz uav5e7PNrTBkg7BDjsc5j5OUUR3B2AlW85J3BnOUWxaYggIIwyLlE8O0ZyxOVJ9/Xu0W gQpyEaYxIeDqSSBrLz9CqELrF9Wc9hcyYxv3WBo0lXkSne/GeEodkNY3uWphmC1FPevN kMVA== X-Gm-Message-State: AMke39m8/JmT6mdKGlfd32i1WF4aR2rLP7WcoCHCFVtKlDzo43RBYtVwr6/gQJGadA0qsYw6dzShqXolAryE5Q== X-Received: by 10.200.55.115 with SMTP id p48mr5420913qtb.209.1487982312857; Fri, 24 Feb 2017 16:25:12 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.102.176 with HTTP; Fri, 24 Feb 2017 16:25:12 -0800 (PST) In-Reply-To: References: From: Chris Lohfink Date: Fri, 24 Feb 2017 18:25:12 -0600 Message-ID: Subject: Re: partition sizes reported by nodetool tablehistograms To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a1137b2c030a94105494fe1ee archived-at: Sat, 25 Feb 2017 00:25:18 -0000 --001a1137b2c030a94105494fe1ee Content-Type: text/plain; charset=UTF-8 Its the decompressed size of the partitions. Each sstable has stats component that contains histograms for the size and number of columns in the partitions (among other things, can see with sstablemetadata tool), tablehistograms merges it for each sstable and gives the results. Chris On Fri, Feb 24, 2017 at 4:53 PM, John Sanda wrote: > I am working on some issues involving really big partitions. I have been > making extensive use of nodetool tablehistograms. What exactly is the > partition size being reported? I have a table for which the max value > reported is about 3.5 GB, but running du -h against the table data > directory reports 548 MB. Are the partition sizes reported by > tablehistograms the decompressed size on disk? > > - John > --001a1137b2c030a94105494fe1ee Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Its the decompressed size of the partitions. Each sstable = has stats component that contains histograms for the size and number of col= umns in the partitions (among other things, can see with sstablemetadata to= ol), tablehistograms merges it for each sstable and gives the results.
=
Chris

On Fri, Feb 24, 2017 at 4:53 PM, John Sanda <john.sand= a@gmail.com> wrote:
I am working on some issues involving really big partitions. I ha= ve been making extensive use of nodetool tablehistograms. What exactly is t= he partition size being reported? I have a table for which the max value re= ported is about 3.5 GB, but running du -h against the table data directory = reports 548 MB. Are the partition sizes reported by tablehistograms the dec= ompressed size on disk?

- John

--001a1137b2c030a94105494fe1ee--