Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CD60C10D34 for ; Tue, 18 Mar 2014 13:50:16 +0000 (UTC) Received: (qmail 276 invoked by uid 500); 18 Mar 2014 13:50:14 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 223 invoked by uid 500); 18 Mar 2014 13:50:12 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 99140 invoked by uid 99); 18 Mar 2014 13:50:09 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Mar 2014 13:50:08 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.160.48 as permitted sender) Received: from [209.85.160.48] (HELO mail-pb0-f48.google.com) (209.85.160.48) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Mar 2014 13:50:02 +0000 Received: by mail-pb0-f48.google.com with SMTP id md12so7279500pbc.7 for ; Tue, 18 Mar 2014 06:49:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:from:subject:date:to; bh=AT4VjbZ8iDi5waXO40NB6DMGOr3QlFJpsvK3DE6dnt8=; b=xG2cH08dguGSyBEWC3PSJJTM5K5vPAlGgstR8LdyrDZtjXkYHqcTJBaDBUn0Y5D69n 08GK3jo26XlUYAciMOdWfHO38Yby9tjQUU4HCHg7rCS7/Sviyti7BNuK2EQQdwrcxtsx Ja5ymqc1Y7LeyiABMYjhF63At77ZmJEtC7gJp4URXBaN2GXE+KaNiuX7hLaQ02qAXKbt S+qwT77TGSXtZlU83qW0QHyJD7dxhCBZ7dgri6CXEOLuNBHhjvXcGRQ0FKk21HP6k2Qc Q1SwZeQi8lq/Vv+g395xoP3xB5YUGzF97OHRUW3A4ZQgsaXs0X3AxCgZhpSlTcKYfdmg pwQw== X-Received: by 10.68.194.97 with SMTP id hv1mr10215246pbc.162.1395150582399; Tue, 18 Mar 2014 06:49:42 -0700 (PDT) Received: from [192.168.0.13] (c-24-130-236-83.hsd1.ca.comcast.net. [24.130.236.83]) by mx.google.com with ESMTPSA id aj7sm88165745pad.29.2014.03.18.06.49.40 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 18 Mar 2014 06:49:40 -0700 (PDT) References: <4BEED2F2-F6FE-4782-A7ED-86FD5DB0ADC0@gmail.com> Mime-Version: 1.0 (1.0) In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: <5E1C65FD-2D42-486E-B3AF-EE9EE2800815@gmail.com> Cc: hbase-dev X-Mailer: iPhone Mail (10B146) From: Ted Yu Subject: Re: Is there a better way to handle too much log Date: Tue, 18 Mar 2014 06:49:40 -0700 To: "dev@hbase.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org If log grows so fast that disk space is to be exhausted, verbosity should be= lowered.=20 Do you turn on DEBUG logging ? Cheers On Mar 18, 2014, at 6:08 AM, haosdent wrote: > Thanks for your reply. DailyRollingFileAppender and a cron job could works= > in normal scenario. But sometimes log grow too fast, or disk space may use= > by other applications. Is there a way make Log more "smart" and choose > policy according to current disk space? >=20 >=20 > On Tue, Mar 18, 2014 at 8:49 PM, Ted Yu wrote: >=20 >> Can you utilize >> http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/DailyRolling= FileAppender.html? >>=20 >> And have a cron job cleanup old logs ? >>=20 >> Cheers >>=20 >> On Mar 18, 2014, at 5:29 AM, haosdent wrote: >>=20 >>> Sometimes the call of Log.xxx couldn't return if the disk partition of >> Log >>> path is full. And HBase would hang because of this. So I think if there >> is >>> a better way to handle too much log. For example, through a configuratio= n >>> item in hbase-site.xml, we could delete the old logs periodically or >> delete >>> old logs when this disk didn't have enough space. >>>=20 >>> I think HBase hang when disk space isn't enough is unacceptable. Looking= >>> forward your ideas. Thanks in advance. >>>=20 >>> -- >>> Best Regards, >>> Haosdent Huang >=20 >=20 >=20 > --=20 > Best Regards, > Haosdent Huang