Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 90D28200C16 for ; Thu, 26 Jan 2017 04:47:31 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 8F967160B5D; Thu, 26 Jan 2017 03:47:31 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D6785160B4E for ; Thu, 26 Jan 2017 04:47:30 +0100 (CET) Received: (qmail 92316 invoked by uid 500); 26 Jan 2017 03:47:29 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 92297 invoked by uid 99); 26 Jan 2017 03:47:29 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jan 2017 03:47:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 5B930C0B3C for ; Thu, 26 Jan 2017 03:47:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -1.999 X-Spam-Level: X-Spam-Status: No, score=-1.999 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id B4uHPLdKPSnC for ; Thu, 26 Jan 2017 03:47:28 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 521755FC5F for ; Thu, 26 Jan 2017 03:47:28 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id B8D09E040C for ; Thu, 26 Jan 2017 03:47:27 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 90EB725296 for ; Thu, 26 Jan 2017 03:47:26 +0000 (UTC) Date: Thu, 26 Jan 2017 03:47:26 +0000 (UTC) From: "Ted Yu (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-17280) Add mechanism to control hbase cleaner behavior MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 26 Jan 2017 03:47:31 -0000 [ https://issues.apache.org/jira/browse/HBASE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839138#comment-15839138 ] Ted Yu commented on HBASE-17280: -------------------------------- Other than log cleaner and hfile cleaner, there're the following in HMaster: {code} private ReplicationMetaCleaner replicationMetaCleaner; private ReplicationZKNodeCleanerChore replicationZKNodeCleanerChore; private ExpiredMobFileCleanerChore expiredMobFileCleanerChore; {code} Why were they excluded from the the runCleaner() method ? For setCleanerRunning(): {code} + .setPrevValue( + master.getLogCleaner().setEnabled(req.getOn()) + && master.getHFileCleaner().setEnabled(req.getOn())).build(); {code} If either log cleaner or hfile cleaner was previously disabled (and request being to enable), the return value would be false. However, shouldn't the caller to this method know which cleaner was disabled ? > Add mechanism to control hbase cleaner behavior > ----------------------------------------------- > > Key: HBASE-17280 > URL: https://issues.apache.org/jira/browse/HBASE-17280 > Project: HBase > Issue Type: Improvement > Components: Client, hbase, shell > Affects Versions: 2.0.0, 1.2.0 > Reporter: Ajay Jadhav > Priority: Minor > Fix For: 2.0.0, 1.2.0 > > Attachments: HBASE-17280.branch-1.2.patch, HBASE-17280.branch-2.0.patch, HBASE-17280.v1-branch-1.2.patch, HBASE-17280.v2-branch-1.2.patch, HBASE-17280.v2-branch-2.patch > > > Cleaner is used to get rid of archived HFiles and old WALs in HBase. > In the case of heavy workload, cleaner can affect query performance by creating a lot of connections to perform costly reads/ writes against underlying filesystem. > This patch allows the user to control HBase cleaner behavior by providing shell commands to enable/ disable and manually run it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)