Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0E544200D34 for ; Fri, 3 Nov 2017 18:12:08 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 0CC21160BFC; Fri, 3 Nov 2017 17:12:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0A80C160BFB for ; Fri, 3 Nov 2017 18:12:06 +0100 (CET) Received: (qmail 84384 invoked by uid 500); 3 Nov 2017 17:12:06 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 84269 invoked by uid 99); 3 Nov 2017 17:12:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Nov 2017 17:12:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id ADC2E18087C for ; Fri, 3 Nov 2017 17:12:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id sSsA9BmB6Pah for ; Fri, 3 Nov 2017 17:12:03 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id D691460E01 for ; Fri, 3 Nov 2017 17:12:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id F08B0E2570 for ; Fri, 3 Nov 2017 17:12:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 1CE70241B4 for ; Fri, 3 Nov 2017 17:12:01 +0000 (UTC) Date: Fri, 3 Nov 2017 17:12:01 +0000 (UTC) From: "Jeff Jirsa (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Issue Comment Deleted] (CASSANDRA-12182) redundant StatusLogger print out when both dropped message and long GC event happen MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 03 Nov 2017 17:12:08 -0000 [ https://issues.apache.org/jira/browse/CASSANDRA-12182?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Jirsa updated CASSANDRA-12182: ----------------------------------- Comment: was deleted (was: I realize it=E2=80=99s s pretty simple patch, but couldn=E2=80=99t no= spamlogger give us this same behavior?) > redundant StatusLogger print out when both dropped message and long GC ev= ent happen > -------------------------------------------------------------------------= ---------- > > Key: CASSANDRA-12182 > URL: https://issues.apache.org/jira/browse/CASSANDRA-1218= 2 > Project: Cassandra > Issue Type: Bug > Reporter: Wei Deng > Assignee: Micha=C5=82 Szczygie=C5=82 > Priority: Minor > Labels: lhf > Attachments: 12182-trunk.txt, 12182-trunk.txt > > > I was stress testing a C* 3.0 environment and it appears that when the CP= U is running low, HINT and MUTATION messages will start to get dropped, and= the GC thread can also get some really long-running GC, and I'd get some r= edundant log entries in system.log like the following: > {noformat} > WARN [Service Thread] 2016-07-12 22:48:45,748 GCInspector.java:282 - G1= Young Generation GC in 522ms. G1 Eden Space: 68157440 -> 0; G1 Old Gen: 3= 376113224 -> 3468387912; G1 Survivor Space: 24117248 -> 0;=20 > INFO [Service Thread] 2016-07-12 22:48:45,763 StatusLogger.java:52 - Po= ol Name Active Pending Completed Blocked All T= ime Blocked > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,775 MessagingService.java:9= 83 - MUTATION messages were dropped in last 5000 ms: 419 for internal timeo= ut and 0 for cross node timeout > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,776 MessagingService.java:9= 83 - HINT messages were dropped in last 5000 ms: 89 for internal timeout an= d 0 for cross node timeout > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,776 StatusLogger.java:52 - = Pool Name Active Pending Completed Blocked All= Time Blocked > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,798 StatusLogger.java:56 - = MutationStage 32 4194 32997234 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,798 StatusLogger.java:56 - = ViewMutationStage 0 0 0 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,799 StatusLogger.java:56 - = ReadStage 0 0 940 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,800 StatusLogger.java:56 - Mu= tationStage 32 4363 32997333 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,801 StatusLogger.java:56 - Vi= ewMutationStage 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,801 StatusLogger.java:56 - Re= adStage 0 0 940 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,802 StatusLogger.java:56 - Re= questResponseStage 0 0 11094437 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,802 StatusLogger.java:56 - Re= adRepairStage 0 0 5 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,803 StatusLogger.java:56 - = RequestResponseStage 4 0 11094509 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,807 StatusLogger.java:56 - = ReadRepairStage 0 0 5 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,808 StatusLogger.java:56 - = CounterMutationStage 0 0 0 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,809 StatusLogger.java:56 - = MiscStage 0 0 0 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,809 StatusLogger.java:56 - = CompactionExecutor 2 62 1234 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,810 StatusLogger.java:56 - = MemtableReclaimMemory 0 0 79 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,810 StatusLogger.java:56 - = PendingRangeCalculator 0 0 3 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,819 StatusLogger.java:56 - = GossipStage 0 0 5214 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,820 StatusLogger.java:56 - = SecondaryIndexManagement 0 0 3 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,820 StatusLogger.java:56 - = HintsDispatcher 1 2 36 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,821 StatusLogger.java:56 - = MigrationStage 0 0 0 0 = 0 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,822 StatusLogger.java:56 - = MemtablePostFlush 1 3 115 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,830 StatusLogger.java:56 - Co= unterMutationStage 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,831 StatusLogger.java:56 - Mi= scStage 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,831 StatusLogger.java:56 - Co= mpactionExecutor 2 62 1234 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,832 StatusLogger.java:56 - Me= mtableReclaimMemory 0 0 79 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,832 StatusLogger.java:56 - Pe= ndingRangeCalculator 0 0 3 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,833 StatusLogger.java:56 - Go= ssipStage 0 0 5214 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,839 StatusLogger.java:56 - Se= condaryIndexManagement 0 0 3 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,840 StatusLogger.java:56 - Hi= ntsDispatcher 1 2 36 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,843 StatusLogger.java:56 - Mi= grationStage 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,844 StatusLogger.java:56 - Me= mtablePostFlush 1 3 115 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,844 StatusLogger.java:56 - Va= lidationExecutor 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,845 StatusLogger.java:56 - Sa= mpler 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,846 StatusLogger.java:56 - Me= mtableFlushWriter 2 2 79 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,846 StatusLogger.java:56 - In= ternalResponseStage 0 0 1978269 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,847 StatusLogger.java:56 - An= tiEntropyStage 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,847 StatusLogger.java:56 - Ca= cheCleanupExecutor 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,848 StatusLogger.java:56 - Na= tive-Transport-Requests 128 133 5903870 8 = 1534827 > INFO [Service Thread] 2016-07-12 22:48:45,848 StatusLogger.java:66 - Co= mpactionManager 2 18 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,870 StatusLogger.java:56 - = ValidationExecutor 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,872 StatusLogger.java:78 - Me= ssagingService n/a 0/16 > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,884 StatusLogger.java:56 - = Sampler 0 0 0 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,885 StatusLogger.java:88 - Ca= che Type Size Capacity Ke= ysToSave > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,885 StatusLogger.java:56 - = MemtableFlushWriter 2 2 79 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,886 StatusLogger.java:90 - Ke= yCache 14240 104857600 = all > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,887 StatusLogger.java:56 - = InternalResponseStage 0 0 1978269 0 = 0 > INFO [Service Thread] 2016-07-12 22:48:45,887 StatusLogger.java:96 - Ro= wCache 0 0 = all > INFO [ScheduledTasks:1] 2016-07-12 22:48:45,888 StatusLogger.java:56 - = AntiEntropyStage 0 0 0 0 = 0 > {noformat} > This makes the log entries harder to read. If we can make StatusLogger co= de to be single entry and subsequent call will just give up and print out a= log like "StatusLogger is busy", that should help to make the log clean. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org For additional commands, e-mail: commits-help@cassandra.apache.org