Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D5B13200B26 for ; Mon, 27 Jun 2016 16:43:54 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D450F160A54; Mon, 27 Jun 2016 14:43:54 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2C94F160A5B for ; Mon, 27 Jun 2016 16:43:54 +0200 (CEST) Received: (qmail 96309 invoked by uid 500); 27 Jun 2016 14:43:52 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 96014 invoked by uid 99); 27 Jun 2016 14:43:52 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Jun 2016 14:43:52 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 4CFFF2C1F60 for ; Mon, 27 Jun 2016 14:43:52 +0000 (UTC) Date: Mon, 27 Jun 2016 14:43:52 +0000 (UTC) From: "T Jake Luciani (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CASSANDRA-12080) More detailed compaction log MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 27 Jun 2016 14:43:55 -0000 [ https://issues.apache.org/jira/browse/CASSANDRA-12080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-12080: --------------------------------------- Resolution: Fixed Status: Resolved (was: Ready to Commit) committed {{fbbedcee81920d17ac2b857eefe1c2b4a9d94b9f}} > More detailed compaction log > ---------------------------- > > Key: CASSANDRA-12080 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12080 > Project: Cassandra > Issue Type: Improvement > Reporter: T Jake Luciani > Assignee: T Jake Luciani > Priority: Trivial > Fix For: 3.8 > > > As mentioned by [~zznate] at NGCC the compaction task info at the end of the compaction log is pretty confusing. > Mainly we only show the throughput of the sstable writer. But if there is a lot of merging being done it might look like compaction is really really slow since the output might be small but the inputs were huge. > Also bytes/sec isn't a great metric of *work* really we should be reporting the CQL row throughput. since for the same bytes on disk we might be compacting 100k rows or 1 large one. > I've added a trivial patch that improves the logging info to now show Read Throughput, Write Throughput, Rows sec and total source partitions. > {quote} > DEBUG [CompactionExecutor:1] 2016-06-23 12:22:06,114 CompactionTask.java:229 - Compacted (9edcfa50-395e-11e6-9944-3109153b1592) 2 sstables to [/home/jake/workspace/cassandra/data/data/stresscql/userpics-b9d2811038b711e69c04018b580faf7b/mb-11-big,] to level=0. 13.159MiB to 6.590MiB (~50% of original) in 2,474ms. Read Throughput = 5.317MiB/s, Write Throughput = 2.663MiB/s, Row Throughput = ~166,666/s. 500,000 total partitions merged to 250,000. Partition merge counts were \{2:250000, \} > {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332)