Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D122C20049D for ; Wed, 9 Aug 2017 21:38:05 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id CF8681684B4; Wed, 9 Aug 2017 19:38:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 21CCD168482 for ; Wed, 9 Aug 2017 21:38:04 +0200 (CEST) Received: (qmail 74335 invoked by uid 500); 9 Aug 2017 19:38:04 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 74324 invoked by uid 99); 9 Aug 2017 19:38:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Aug 2017 19:38:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 881A41802AA for ; Wed, 9 Aug 2017 19:38:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id dXeo5NlicYPg for ; Wed, 9 Aug 2017 19:38:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 49A2A5FB4E for ; Wed, 9 Aug 2017 19:38:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 5D0DCE002C for ; Wed, 9 Aug 2017 19:38:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 5AC0B24161 for ; Wed, 9 Aug 2017 19:38:00 +0000 (UTC) Date: Wed, 9 Aug 2017 19:38:00 +0000 (UTC) From: "Ted Yu (JIRA)" To: dev@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HBASE-18547) Provide better cleanup of WAL related entries in backup table MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 09 Aug 2017 19:38:06 -0000 Ted Yu created HBASE-18547: ------------------------------ Summary: Provide better cleanup of WAL related entries in backup table Key: HBASE-18547 URL: https://issues.apache.org/jira/browse/HBASE-18547 Project: HBase Issue Type: Bug Reporter: Ted Yu I was discussing the design around incremental backup with Vladimir. Currently if WAL file is recorded in backup table, BackupLogCleaner would signal that the file can be cleaned up. However, cleaner chore doesn't notify BackupLogCleaner whether the file is actually deleted. This means that potentially large number of WAL files would stay in backup table. This issue is to investigate better cleanup strategy for the WAL entries. -- This message was sent by Atlassian JIRA (v6.4.14#64029)