Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C5DBF200BE3 for ; Thu, 8 Dec 2016 01:41:07 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id C4955160B26; Thu, 8 Dec 2016 00:41:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E60AF160B0C for ; Thu, 8 Dec 2016 01:41:06 +0100 (CET) Received: (qmail 14597 invoked by uid 500); 8 Dec 2016 00:41:05 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 14587 invoked by uid 99); 8 Dec 2016 00:41:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2016 00:41:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id D98511ABB08 for ; Thu, 8 Dec 2016 00:41:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.12 X-Spam-Level: X-Spam-Status: No, score=-3.12 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=walmartlabs.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id QRZwfXE7NbMX for ; Thu, 8 Dec 2016 00:41:02 +0000 (UTC) Received: from PPES-Mail-E2.wal-mart.com (ppes-mail-e2.wal-mart.com [161.165.225.16]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id B34BE5FC4D for ; Thu, 8 Dec 2016 00:40:57 +0000 (UTC) Received: from pps.filterd (PPES-Mail-E2.wal-mart.com [127.0.0.1]) by PPES-Mail-E2.wal-mart.com (8.16.0.17/8.16.0.17) with SMTP id uB80P3kP028787; Wed, 7 Dec 2016 18:40:50 -0600 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=walmartlabs.com; h=from : to : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=mail; bh=7Nxk6D91wEb2Fca4P9BNKTcVi+PbtH6ue8CW9hvk4ic=; b=W9cx/1LcbK4NRFQT554MHMX+pmCorJwvM/rsscKB4/FUDAU0kAyvGmmcHjMt6QBmGbVh 9s3mTZLfxrsyRB12hOwbiKjI/jmxBAEGXOBbYAB73TUMnCqJIOPoSvq/iRWkbjVaX6of PmvBOne99nNSKAo43g1YDJ0IrDCNhf29CkcMQJCYNdE0YRPpv9cADcoArEe/vd762roj L6oTYxzYD9X84kQS5bK+p6KuRJibc+CqxTPen80urwEHt/RmOFDa7qLIueqPz3dNQRCf fhWKNybCR8h1Tblr44bc12IgHryRIpF9hQhUkAYZwDE+NQsbtHBNo2PXgnp5gahU79wH uw== Received: from oser500439.wal-mart.com ([161.165.225.1]) by PPES-Mail-E2.wal-mart.com with ESMTP id 273ryteuv1-8; Wed, 07 Dec 2016 18:40:50 -0600 Received: from PHONT10105USB.homeoffice.Wal-Mart.com (10.24.7.106) by HONTS35010.homeoffice.Wal-Mart.com (172.27.184.52) with Microsoft SMTP Server (TLS) id 14.3.279.2; Wed, 7 Dec 2016 18:40:03 -0600 Received: from na01-bn1-obe.outbound.protection.outlook.com (10.10.197.231) by hybrid.wal-mart.com (10.24.7.106) with Microsoft SMTP Server (TLS) id 14.3.279.2; Wed, 7 Dec 2016 18:40:03 -0600 Received: from CO1P100MB0103.NAMP100.PROD.OUTLOOK.COM (129.75.48.86) by CO1P100MB0104.NAMP100.PROD.OUTLOOK.COM (129.75.48.87) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.761.13; Thu, 8 Dec 2016 00:40:00 +0000 Received: from CO1P100MB0103.NAMP100.PROD.OUTLOOK.COM ([129.75.48.86]) by CO1P100MB0103.NAMP100.PROD.OUTLOOK.COM ([129.75.48.86]) with mapi id 15.01.0761.018; Thu, 8 Dec 2016 00:40:00 +0000 From: Harikrishnan Pillai To: User , Sotirios Delimanolis Subject: Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy Thread-Topic: Huge files in level 1 and level 0 of LeveledCompactionStrategy Thread-Index: AQHSUOtA1Yf4gl8MV0KTpSG4Bj/goqD9NUJc Date: Thu, 8 Dec 2016 00:40:00 +0000 Message-ID: References: <1433348268.37488.1481157345693.ref@mail.yahoo.com>,<1433348268.37488.1481157345693@mail.yahoo.com> In-Reply-To: <1433348268.37488.1481157345693@mail.yahoo.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [161.170.193.135] x-ms-office365-filtering-correlation-id: aac8e379-aae0-484b-a2df-08d41f02be0c x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:CO1P100MB0104; x-microsoft-exchange-diagnostics: 1;CO1P100MB0104;20:huK3bn5poZotcviChHvSfWGFoMwdP3VuNagWS1fWhIEXG0aekIJ2Aop9vQbQUn9S2sxWVQSlAiE1CX8m5jXqt1wGJtoImMOHhtez+8x4NSNDcX8bhq7A3RwpZdAB+9qJZFnsDwihK+guL1M6nQ8XZwAhBgNHz0O39UUq3Qo8liiU46rLjmLzWXtDBP8MvW1cXFDlJcoNv4gRZXdIi1RrESsvMu3XWTBdOCBItXPu+Jokt72Btoxs8YQPbqUrxXxs2V0nhGMvkzjgKIZLt4I23/1cltHHMoiVjekNWV9XjU7YSwJadx6HmFjRqy/KmL34o+IRmfEobYrVqD+jl+4s8DXupx1+jFtt6HtKZ54jesa9v7ismxnGWWUdxuJJ/NnFGBUt97WMsJtxMfvYzbewpHuARB2zWmvwwSC+iGVO+UK2soBgYj2jOYRMFiQ9DQDKYKOGWfHABxog1feY74+XVGZ9v3AOg7fXA3Fd8Lo1qvHTq65cEADLIsRHtkDW8kKn x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(20558992708506)(201166117486090); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040375)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6041248)(20161123555025)(20161123562025)(20161123564025)(20161123560025)(6072148);SRVR:CO1P100MB0104;BCL:0;PCL:0;RULEID:;SRVR:CO1P100MB0104; x-forefront-prvs: 0150F3F97D x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(6009001)(7916002)(39410400002)(39450400003)(39850400002)(39840400002)(199003)(377454003)(189002)(2521001)(102836003)(101416001)(81156014)(3846002)(6116002)(8676002)(19627405001)(81166006)(106356001)(54356999)(50986999)(122556002)(76176999)(5660300001)(2950100002)(92566002)(86362001)(8936002)(2900100001)(7696004)(2906002)(106116001)(33656002)(38730400001)(9686002)(3660700001)(107886002)(66066001)(39060400001)(229853002)(5001770100001)(7846002)(97736004)(105586002)(3280700002)(6506006)(80792005)(7736002)(74316002)(189998001)(68736007)(14583001);DIR:OUT;SFP:1101;SCL:1;SRVR:CO1P100MB0104;H:CO1P100MB0103.NAMP100.PROD.OUTLOOK.COM;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: walmartlabs.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_CO1P100MB0103FA28496B9E3B02CE7634A0840CO1P100MB0103NAMP_" MIME-Version: 1.0 X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Dec 2016 00:40:00.1814 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 3cbcc3d3-094d-4006-9849-0d11d61f484d X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1P100MB0104 X-OriginatorOrg: walmartlabs.com X-CFilter-Loop: oser500439 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-12-07_08:,, signatures=0 archived-at: Thu, 08 Dec 2016 00:41:08 -0000 --_000_CO1P100MB0103FA28496B9E3B02CE7634A0840CO1P100MB0103NAMP_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable This can happen as part of node bootstrap,repair or rebuild node. ________________________________ From: Sotirios Delimanolis Sent: Wednesday, December 7, 2016 4:35:45 PM To: User Subject: Huge files in level 1 and level 0 of LeveledCompactionStrategy I have a couple of SSTables that are humongous -rw-r--r-- 1 user group 138933736915 Dec 1 03:41 lb-29677471-big-Data.db -rw-r--r-- 1 user group 78444316655 Dec 1 03:58 lb-29677495-big-Data.db -rw-r--r-- 1 user group 212429252597 Dec 1 08:20 lb-29678145-big-Data.db sstablemetadata reports that these are all in SSTable Level 0. This table i= s running with compaction =3D {'sstable_size_in_mb': '200', 'tombstone_threshold': '0.25',= 'tombstone_compaction_interval': '300', 'class': 'org.apache.cassandra.db.= compaction.LeveledCompactionStrategy'} How could this happen? --_000_CO1P100MB0103FA28496B9E3B02CE7634A0840CO1P100MB0103NAMP_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

This can happen as part of node bootstrap,repair or rebuild node.

From: Sotirios Delimanolis = <sotodel_89@yahoo.com>
Sent: Wednesday, December 7, 2016 4:35:45 PM
To: User
Subject: Huge files in level 1 and level 0 of LeveledCompactionStrat= egy
 
I have a couple of SSTables that are humongous 

-rw-r--r-- 1 user group 138933736915 Dec  1 03:41 lb-= 29677471-big-Data.db
-rw-r--r-- 1 user group  78444316655 Dec  1= 03:58 lb-29677495-big-Data.db
-rw-r--r-- 1 user group 212429252597 Dec  1= 08:20 lb-29678145-big-Data.db

sstablemetadata reports that these are all in SSTable Level 0. This table is running with

compaction =3D {'sstable_size_in_mb= ': '200', 'tombstone_threshold': '0.25', 'tombstone_compaction_interval': '= 300', 'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrateg= y'}

How could this happen?
--_000_CO1P100MB0103FA28496B9E3B02CE7634A0840CO1P100MB0103NAMP_--