Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id EEF12200BF1 for ; Tue, 3 Jan 2017 17:08:46 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id ED7B2160B43; Tue, 3 Jan 2017 16:08:46 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 16F41160B33 for ; Tue, 3 Jan 2017 17:08:45 +0100 (CET) Received: (qmail 81641 invoked by uid 500); 3 Jan 2017 16:08:44 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 81627 invoked by uid 99); 3 Jan 2017 16:08:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Jan 2017 16:08:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 636C11A0416 for ; Tue, 3 Jan 2017 16:08:43 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.48 X-Spam-Level: ** X-Spam-Status: No, score=2.48 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id q1-lPYuGBzAf for ; Tue, 3 Jan 2017 16:08:40 +0000 (UTC) Received: from mail-wm0-f45.google.com (mail-wm0-f45.google.com [74.125.82.45]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 2E2905F24E for ; Tue, 3 Jan 2017 16:08:40 +0000 (UTC) Received: by mail-wm0-f45.google.com with SMTP id a197so388178143wmd.0 for ; Tue, 03 Jan 2017 08:08:40 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=LMXJ3buRH9R2aaGOy+Oi9KY3gW3pKRE4QjRKhXvhSZw=; b=V29dxXnrRrIRyV31NSfKGBiiYIkj//EWngMWUcvca82OUp+m5VIUyKpzkgwG4a2Bbd PDREQUUAjVi+AUPcSPvPWGmFZoG33XZQRQedw+FHwDEiRSsb31G9DCS62kUGNi4SZ8Qr qOCOZw22VVisVOjzLewwK5JZwnmWhhjYlY/c8u9l6j/PQlsj3QG6uzgMUYT5oF9CdgOT 1Dqe3X4OAMxCmGFDQIboBktrOzAhlKcc6ErAJUPMZY/azSTWrTkIoGRxMJSkjIHqMZoW ykqxh4Sgun8DbJ14Bdj5nN9wX/9f0hsuQN4AzXz6Y5zD3POkpY/JY1HqxfuIjYjXkQkN hzyw== X-Gm-Message-State: AIkVDXJZbv0r3k/wUsLyUO/pcdW8tkh7J9w8bWtUOi0ogtZNyp3yi7kR5D/e2CubQNOPwaD7Nz3Xk8vXBVX6qPjz6hUClcuMXe8ELYYunIOnfUyfy8CXuaQiwSIOvzhKLEITpqqk4dFWyz18UjjnDLj9R4g= X-Received: by 10.28.111.138 with SMTP id c10mr53218047wmi.135.1483459685296; Tue, 03 Jan 2017 08:08:05 -0800 (PST) MIME-Version: 1.0 Received: by 10.194.140.205 with HTTP; Tue, 3 Jan 2017 08:08:04 -0800 (PST) In-Reply-To: References: From: Webster Homer Date: Tue, 3 Jan 2017 10:08:04 -0600 Message-ID: Subject: Re: CDCR logging is Needlessly verbose, fills up the file system fast To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=001a1147cdf494e884054532df72 archived-at: Tue, 03 Jan 2017 16:08:47 -0000 --001a1147cdf494e884054532df72 Content-Type: text/plain; charset=UTF-8 I am working on changing the log rotation, but looking at the message: 2016-12-21 23:24:41.653 INFO (qtp110456297-18) [c:sial-catalog-material s:shard1 r:core_node1 x:sial-catalog-material_shard1_replica1] o.a.s.c.S.Request [sial-catalog-material_shard1_replica1] webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0 I can't tell which class is generating it On Thu, Dec 29, 2016 at 3:15 PM, Erick Erickson wrote: > Seems like a bandaid would be to insure your Solr logs rotate > appropriately quickly. > > That doesn't address the CDCR loging verbosity, but it might get you by. > > You can also change the logging at the class level by appropriately > editing the > log4j properties file. Again perhaps not the best solution but one > that's immediately > available. > > Best, > Erick > > On Thu, Dec 29, 2016 at 10:37 AM, Webster Homer > wrote: > > The logs filled up the file system and caused CDCR to fail due to a > > corrupted Tlog file. > > > > On Thu, Dec 22, 2016 at 9:10 AM, Webster Homer > > wrote: > > > >> While testing CDCR I found that it is writing tons of log messages per > >> second. Example: > >> 2016-12-21 23:24:41.652 INFO (qtp110456297-13) [c:sial-catalog-material > >> s:shard1 r:core_node1 x:sial-catalog-material_shard1_replica1] > >> o.a.s.c.S.Request [sial-catalog-material_shard1_replica1] webapp=/solr > >> path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin& > version=2} > >> status=0 QTime=0 > >> 2016-12-21 23:24:41.653 INFO (qtp110456297-18) [c:sial-catalog-material > >> s:shard1 r:core_node1 x:sial-catalog-material_shard1_replica1] > >> o.a.s.c.S.Request [sial-catalog-material_shard1_replica1] webapp=/solr > >> path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin& > version=2} > >> status=0 QTime=0 > >> 2016-12-21 23:24:41.655 INFO (qtp110456297-14) [c:sial-catalog-material > >> s:shard1 r:core_node1 x:sial-catalog-material_shard1_replica1] > >> o.a.s.c.S.Request [sial-catalog-material_shard1_replica1] webapp=/solr > >> path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin& > version=2} > >> status=0 QTime=0 > >> 2016-12-21 23:24:41.657 INFO (qtp110456297-17) [c:sial-catalog-material > >> s:shard1 r:core_node1 x:sial-catalog-material_shard1_replica1] > >> o.a.s.c.S.Request [sial-catalog-material_shard1_replica1] webapp=/solr > >> path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin& > version=2} > >> status=0 QTime=0 > >> > >> > >> These should be DEBUG messages and NOT INFO messages. Is there a way to > >> selectively turn them off? The above is from a Target collection, it is > >> even worse on the Source side. > >> > >> I'd rather not change my logging level as most INFO messages are useful. > >> > >> This is a very poor default logging level for these messages. > >> > > > > -- > > > > > > This message and any attachment are confidential and may be privileged or > > otherwise protected from disclosure. If you are not the intended > recipient, > > you must not copy this message or attachment or disclose the contents to > > any other person. If you have received this transmission in error, please > > notify the sender immediately and delete the message and any attachment > > from your system. Merck KGaA, Darmstadt, Germany and any of its > > subsidiaries do not accept liability for any omissions or errors in this > > message which may arise as a result of E-Mail-transmission or for damages > > resulting from any unauthorized changes of the content of this message > and > > any attachment thereto. Merck KGaA, Darmstadt, Germany and any of its > > subsidiaries do not guarantee that this message is free of viruses and > does > > not accept liability for any damages caused by any virus transmitted > > therewith. > > > > Click http://www.merckgroup.com/disclaimer to access the German, French, > > Spanish and Portuguese versions of this disclaimer. > -- This message and any attachment are confidential and may be privileged or otherwise protected from disclosure. If you are not the intended recipient, you must not copy this message or attachment or disclose the contents to any other person. If you have received this transmission in error, please notify the sender immediately and delete the message and any attachment from your system. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not accept liability for any omissions or errors in this message which may arise as a result of E-Mail-transmission or for damages resulting from any unauthorized changes of the content of this message and any attachment thereto. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not guarantee that this message is free of viruses and does not accept liability for any damages caused by any virus transmitted therewith. Click http://www.emdgroup.com/disclaimer to access the German, French, Spanish and Portuguese versions of this disclaimer. --001a1147cdf494e884054532df72--