Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id CCAA8200CE7 for ; Sat, 2 Sep 2017 04:17:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id C385A16DF13; Sat, 2 Sep 2017 02:17:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 15A0116DF0F for ; Sat, 2 Sep 2017 04:17:21 +0200 (CEST) Received: (qmail 21622 invoked by uid 500); 2 Sep 2017 02:17:20 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 21612 invoked by uid 99); 2 Sep 2017 02:17:19 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Sep 2017 02:17:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 74E24C1C14 for ; Sat, 2 Sep 2017 02:17:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.629 X-Spam-Level: X-Spam-Status: No, score=0.629 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id bPkQMNIKp97s for ; Sat, 2 Sep 2017 02:17:13 +0000 (UTC) Received: from mail-pg0-f67.google.com (mail-pg0-f67.google.com [74.125.83.67]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id D7E9D5FB2E for ; Sat, 2 Sep 2017 02:17:12 +0000 (UTC) Received: by mail-pg0-f67.google.com with SMTP id m15so1117821pgc.0 for ; Fri, 01 Sep 2017 19:17:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=neDMtXUE/4mt7IGze1GRyOROCCcICtUOk7va6E8Wavw=; b=adWwal7g935aK2kn8kHqByX+anm4yMBafZi30qnLXxKds8d73cB2W1Cyepx/ewJEFQ FNNS0YArl0Mp+ramGNLdTDrKXDGGHd8CfYPIKF+t8ocsTqQiT8bfuz4WXFc3gZ2SV2hU 2oknJdbusNZPFBPl6BVSNFL+8XTgzTxqnOxWp8hXOYxwJF+x5QVs5h1W8uZPzlJttcga tN3j4uVxzIe1ey5bkEHXOwF6ocl7AX9ozlQ2nTl9zGcvSeZ9MHEym4Vw0ag9PyAncJqO bVegudZ8mAML+avrNlWI4ncfw/uT6QsWxqiUyPoXi8nVL3bmGCotyxoTr6TAaA8XTVN2 /j9A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=neDMtXUE/4mt7IGze1GRyOROCCcICtUOk7va6E8Wavw=; b=gMMnthjGUl0ud54exqZvh71OazGVAUz8CuM9bIEsHzVuWL0cEcCdrJ996KRHFdASvE BimaO8xnJ9Ozhq3T8y4FI4TEblSwDvs+J10hnGeZ/8A3SGUxktGdlSrhV6AOxCEzWyF2 85QSRTPEDB6JGyCf7aQVr+jTdCZdfmyDcc7QtgGmHYsQaqEn9+eqcBviDuENwOccsVjR eIe36kFdpCfsEXzRza/Ow3DRBHMlrwk6WB5F40b9uA1y3WxPpAK4bTxKXkKisW1w6UR+ jk8MuCIbkZlGW52sBVuCYgkrlJQMeXUfi0tEt4Eq0Vgw/Ew6k29a0xwdYQ0VamvnTqwF V6DA== X-Gm-Message-State: AHPjjUiHQfJzUhe2IK0wje6xk/Olw1TtWcy6uCvy5qloD1LSU5aeQ7a+ FpfBcM2QjrELTrwU1vk= X-Google-Smtp-Source: ADKCNb4lZ8jdlg5nT4RG6hzcYB+W2jeustDNb0DxxV+JhuQQAu3fuvmNKVpZzox5gAuHJjeS0SxPeg== X-Received: by 10.99.134.65 with SMTP id x62mr4658308pgd.290.1504318631253; Fri, 01 Sep 2017 19:17:11 -0700 (PDT) Received: from [10.10.10.5] ([115.204.223.64]) by smtp.gmail.com with ESMTPSA id f80sm1847828pfk.46.2017.09.01.19.17.09 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 01 Sep 2017 19:17:10 -0700 (PDT) From: qf zhou Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: How to do cassandra routine maintenance Message-Id: Date: Sat, 2 Sep 2017 10:17:14 +0800 To: "user@cassandra.apache.org" X-Mailer: Apple Mail (2.3273) archived-at: Sat, 02 Sep 2017 02:17:23 -0000 I am using the cluster with 3 cassandra nodes, the cluster version is = 3.0.9. Each day about 200~300 million records are inserted into the = cluster. As time goes by, more and more data occupied more and more disk space. = Currently, the data distribution on each node is as the following: UN 172.20.5.4 2.5 TiB 256 66.3% = c5271e74-19a1-4cee-98d7-dc169cf87e95 rack1 UN 172.20.5.2 1.73 TiB 256 67.0% = c623bbc0-9839-4d2d-8ff3-db7115719d59 rack1 UN 172.20.5.3 1.86 TiB 256 66.7% = c555e44c-9590-4f45-aea4-f5eca68180b2 rack1=20 There is only one datacenter. =20 The compaciton strategy is here: compaction =3D {'class': = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', = 'max_threshold': '32', 'min_threshold': '12', 'tombstone_threshold': = '0.1', 'unchecked_tombstone_compaction': 'true'} AND compression =3D {'chunk_length_in_kb': '64', 'class': = 'org.apache.cassandra.io.compress.LZ4Compressor'} AND crc_check_chance =3D 1.0 AND dclocal_read_repair_chance =3D 0.1 AND default_time_to_live =3D 8640000 AND gc_grace_seconds =3D 432000 I really want to know about how to do cassandra routine maintenance ? I found the data seems to grow faster and the disk is in heavy load. = Sometimes I found the data inconsistency: two different results appear = with the same query. So what I shoud I do to keep the cluster healthy, how to maintain the = cluster? I hope some help very much! Thanks a lot !=20 --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org For additional commands, e-mail: user-help@cassandra.apache.org