Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C0A51200CEC for ; Tue, 1 Aug 2017 08:08:40 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id BEB5916685A; Tue, 1 Aug 2017 06:08:40 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 84F78166859 for ; Tue, 1 Aug 2017 08:08:39 +0200 (CEST) Received: (qmail 28576 invoked by uid 500); 1 Aug 2017 06:08:37 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 28565 invoked by uid 99); 1 Aug 2017 06:08:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Aug 2017 06:08:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 0557118008F for ; Tue, 1 Aug 2017 06:08:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.541 X-Spam-Level: X-Spam-Status: No, score=0.541 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, MIME_QP_LONG_LINE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.8, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URG_BIZ=0.941] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Da3YPYtAqdum for ; Tue, 1 Aug 2017 06:08:36 +0000 (UTC) Received: from mail-pg0-f43.google.com (mail-pg0-f43.google.com [74.125.83.43]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id BE45C5FC1C for ; Tue, 1 Aug 2017 06:08:35 +0000 (UTC) Received: by mail-pg0-f43.google.com with SMTP id v189so3866478pgd.2 for ; Mon, 31 Jul 2017 23:08:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:date:subject:message-id :references:in-reply-to:to; bh=OqEhBWt90FuGUjL3n+O0fUt2GkEGAlzI6u+QJGnzc44=; b=YaQX727SgugfzlFAm22fHXl3fxTKjtj443oKNXDs3zObAiG82tc3bUuejZmSeCrx/I yOfu+SNG8u9haW711mYj0XPMAUFRZzXy6GP2Ab18xUyYx/X+hVSZqVs1hPYyxN+aJ0iS 99pNNSh6hZ2xrWQcKow7iVgOe92D2OUNneoFzdWZQ0eCAfS7z9g7jmKmFwwdUadLz8Lr P+gMu1ezspYh8gr3a1lICVVMxWyKByWaro/cRSTrLf+smH6TXS6fIcK/lBlA4b1LRPnW 6woFK5HrWT+SoTBM5UcCWZQi5U5IVZh0cHtw6z3ou4gXYLkTYylo5tqEe3PeIQwMpxPH uKcQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version:date :subject:message-id:references:in-reply-to:to; bh=OqEhBWt90FuGUjL3n+O0fUt2GkEGAlzI6u+QJGnzc44=; b=jFyJ0SIT2Xk7HO+TkkGs3a2900Xn8t6cRZkrS1fKt3L07mNsEkWUYMPAg6UXw/hZ4m aolBHaLUV6eyC4QlNs6VcUEjs8Ef7dX9iKHRDYA1ST5aPk6Kp8a5jAqzD/QH/H/qOhwM 6DiHxOshVLrB8kJrAoZShdiMxDv5lrCO9UFTJ3AVtdtnQk47H7fmfA3DOTnFEv3WRWCN LnMb4S+BcXqOt2Xz7MymfwNflXpeGPEEKKUDc5J/zVGVkqN7sRO1roVUP+2mRWQUDH1I nMFXf/kY9nNaS1nGRk1qvNLZDLCrkzek0ST7Y1+JRYUwfMulAW5trV1HQ0d+aYi6wRDX SvtQ== X-Gm-Message-State: AIVw110dhQnVsCrfSxyGfmsOs59horX0ahrERg4aVOuJYLA3mw3rhnGy D3c8OKdmV/6CnKOZapY= X-Received: by 10.99.173.2 with SMTP id g2mr17947392pgf.309.1501567708473; Mon, 31 Jul 2017 23:08:28 -0700 (PDT) Received: from [192.168.0.49] (97-113-209-199.tukw.qwest.net. [97.113.209.199]) by smtp.gmail.com with ESMTPSA id v9sm32695377pgo.39.2017.07.31.23.08.27 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 31 Jul 2017 23:08:27 -0700 (PDT) From: Jeff Jirsa Content-Type: multipart/alternative; boundary=Apple-Mail-24E0C742-AF20-4AC9-9C3E-0625013B65BB Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Date: Mon, 31 Jul 2017 23:08:27 -0700 Subject: Re: How to minimize side effects induced by tombstones when using deletion? Message-Id: References: In-Reply-To: To: user@cassandra.apache.org X-Mailer: iPhone Mail (14G60) archived-at: Tue, 01 Aug 2017 06:08:40 -0000 --Apple-Mail-24E0C742-AF20-4AC9-9C3E-0625013B65BB Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Delete using as few tombstones as possible (deleting the whole partition is b= etter than deleting a row; deleting a range of rows is better than deleting m= any rows in a range). Repair often and lower gc_grace_seconds so the tombstones can be collected m= ore frequently --=20 Jeff Jirsa > On Jul 31, 2017, at 11:02 PM, Jing Meng wrote: >=20 > Hi there. >=20 >=20 >=20 > We have a keyspace containing tons of records, and deletions are used as e= nforced by its business logic. >=20 >=20 > As the data accumulates, we are suffering from performance penalty due to t= ombstones, still confusing about what could be done to minimize the harm, or= shall we avoid any deletions and adapt our code? >=20 >=20 > FYI, if it=E2=80=99s concerned, we are using C* 2.1.18. >=20 >=20 >=20 > Thanks for your urgent replying. >=20 >=20 >=20 --Apple-Mail-24E0C742-AF20-4AC9-9C3E-0625013B65BB Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Delete using as few tombstones as poss= ible (deleting the whole partition is better than deleting a row; deleting a= range of rows is better than deleting many rows in a range).

Repair often a= nd lower gc_grace_seconds so the tombstones can be collected more frequently=


-- 
Jeff Jirsa


On Jul 31, 2= 017, at 11:02 PM, Jing Meng <sel= f.reload@gmail.com> wrote:

Hi there.


We have a keyspace containing tons of records, and d= eletions are used as enforced by its business logic.

As the data accumulates, we are suffering from p= erformance penalty due to tombstones, still confusing about what could be do= ne to minimize the harm, or shall we avoid any deletions and adapt our code?=

FYI, if it=E2=80=99s concerned, we are using C* 2.1.= 18.


Thanks for your urgent replying.


= --Apple-Mail-24E0C742-AF20-4AC9-9C3E-0625013B65BB--