From user-return-61151-archive-asf-public=cust-asf.ponee.io@cassandra.apache.org Wed May 23 22:05:59 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 03336180645 for ; Wed, 23 May 2018 22:05:58 +0200 (CEST) Received: (qmail 52448 invoked by uid 500); 23 May 2018 20:05:57 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 52438 invoked by uid 99); 23 May 2018 20:05:57 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 May 2018 20:05:57 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id C8B271807A5 for ; Wed, 23 May 2018 20:05:56 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id BAlughWdoWE3 for ; Wed, 23 May 2018 20:05:55 +0000 (UTC) Received: from mail-it0-f43.google.com (mail-it0-f43.google.com [209.85.214.43]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id A66745F126 for ; Wed, 23 May 2018 20:05:54 +0000 (UTC) Received: by mail-it0-f43.google.com with SMTP id e20-v6so5934354itc.1 for ; Wed, 23 May 2018 13:05:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=nk4OWYGqgF0xW40S/tHDYcD0qlhAazP0w0A8vZgS/cM=; b=tdf9W3R41PpTiYd2tMbuam/zS28GT0N2I6QFZREUxajIBcjoIGI2eQUKztBv+ajstK gJjGhAtL+4vYjN0Ec9D7PkbUkwa2mRw8sgNzrFyFQZFUrNamfBFCZamrno8Nf70nKJu7 pdCndSBqzej6HFEp7N1QnEa20vqcOH6KEOqQdnczUE91wtBkcgr8RDtBC1Dhhu8yR2A3 5MkKk163hEffyOkm1eqr0jn2Tuv8e26pXJa6rNhudrQKtZGxrlqa3Z051uEf34oUwW5m Qv90Eu0BGd7QNqN0c0rUttPpKcusCJRK5bZ8FzlUsQXp/C0C5wgS3i62DNbG47NNeECz e2Kw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=nk4OWYGqgF0xW40S/tHDYcD0qlhAazP0w0A8vZgS/cM=; b=Awsv+SDki2U20miP1JQZonG9RVZ7cXKPdJv7NCWFNXT1zhOhbvcYqLRPRXdsq06+VC XLk08dORUbH8TBCl6wLHaj5hoy6IJjtJmkdfWTi4sgYs1h5uE2a3IcmBiPMbicRBSmjp 2buqFw4E2mwj3TWwYy7QGGJDa1wdkcCXEvnLacEtMIO4WZZzQs8Ma3syDqMSeuzvyIUK irYCVI7v9w24WCxobtSPMJBGsaT5+MrZd0MItbjOGmH7soQnydfZVYOOCEXAjAaTJhHd hhiuwMBoEgD8ZJXS1GWztAUio3ukcBTmTg9XTe4M3kiyMUMAAKrEE5sHld4aNqexFXrT SGyw== X-Gm-Message-State: ALKqPwcLWx91vuzGcfTn1uaNlv3DeuLJlZgW+SdhmmEIK4s773R1gr/n s2KgIQiTOV8KG6cjKneqUtoAdlh9MuaMYAsGPEt/Zw== X-Google-Smtp-Source: AB8JxZqMWPxawvoqrB3U6lNtiCy8gpiGFA9UU0DbIHlol49V+jvGTwSbrR+cZl/5r60a0CjRldkePDwnCds3/85s/Dc= X-Received: by 2002:a24:4151:: with SMTP id x78-v6mr6687556ita.0.1527105953278; Wed, 23 May 2018 13:05:53 -0700 (PDT) MIME-Version: 1.0 References: <72556681-9580-4ad1-b147-1f9158bfac4f@Spark> In-Reply-To: <72556681-9580-4ad1-b147-1f9158bfac4f@Spark> From: Eric Stevens Date: Wed, 23 May 2018 14:03:53 -0600 Message-ID: Subject: Re: estimated number of keys vs ttl To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary="000000000000e142e5056ce50f56" --000000000000e142e5056ce50f56 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I believe that key estimates won't immediately respond to expired TTL, Not until after compaction has completely dropped the records (which will include subtle logic related to gc_grace and partitions with data in multiple SSTables). On Wed, May 23, 2018 at 6:18 AM Rahul Singh wrote: > If the TTL actually reduces the key count , should. It=E2=80=99s possible= to TTL a > row from a partition but not the whole partition. 1 key =3D 1 partition != =3D 1 > row !=3D 1 cell > > -- > Rahul Singh > rahul.singh@anant.us > > Anant Corporation > > On May 23, 2018, 6:07 AM -0500, Grzegorz Pietrusza = , > wrote: > > Hi > > I'm using tablestats to get estimated number of partitioning keys. In my > case all writes are done with TTL of a few days. Is the key count decreas= ed > when TTL hits? > > Regards > Grzegorz > > --000000000000e142e5056ce50f56 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I believe that key estimates won't immediately respond= to expired TTL, Not until after compaction has completely dropped the reco= rds (which will include subtle logic related to gc_grace and partitions wit= h data in multiple SSTables).

On Wed, May 23, 2018 at 6:18 AM Rahul Singh <rahul.xavier.singh@gmail.com> wrote:
If the TTL actually reduces the key count = , should. It=E2=80=99s possible to TTL a row from a partition but not the w= hole partition. 1 key =3D 1 partition !=3D 1 row !=3D 1 cell

--
Rahul Singh
rahul.singh@anant= .us

Anant Corporation

On May 23, 2018, 6:07 AM -0500, Grzegorz Pietrusza <gpietrusza@gmail.com>, wrote:<= br>
Hi

I'm using tablestats to get estimated number of partitioning keys.= In my case all writes are done with TTL of a few days. Is the key count de= creased when TTL hits?

Regards
Grzegorz
--000000000000e142e5056ce50f56--