Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 45EA818244 for ; Wed, 13 Jan 2016 00:59:40 +0000 (UTC) Received: (qmail 40793 invoked by uid 500); 13 Jan 2016 00:59:40 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 40723 invoked by uid 500); 13 Jan 2016 00:59:40 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 40701 invoked by uid 99); 13 Jan 2016 00:59:39 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Jan 2016 00:59:39 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id CC3F92C1F58 for ; Wed, 13 Jan 2016 00:59:39 +0000 (UTC) Date: Wed, 13 Jan 2016 00:59:39 +0000 (UTC) From: "Vladimir Rodionov (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-15094) Selection of WAL files eligible for incremental backup is broken MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-15094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Rodionov updated HBASE-15094: -------------------------------------- Description: We should add to a selection WAL files which have been copied over by different backup sessions and which are newer than the most recent files processed for a given table. Currently, we look for WAL files only in a files system (WALs and OldWALs directories) Scenario Backup T1 Backup T2 add WAL1 Backup T1 (WAL1 becomes eligible for deletion) some time later Backup T2 (WAL1 can be deleted by this time and won't get it into WAL file list for T2) was: We should add to a selection WAL files which have been copied over by different backup sessions and which are newer than the most recent files processed for a given table. Currently, we look for WAL files only in a files system (WALs and OldWALs directories) Scenario Backup T1 Backup T2 add WAL1 Backup T1 (WAL1 becomes eligible for deletion) - some time later Backup T2 (WAL1 can be deleted by this time and won't get it into WAL file list for T2) > Selection of WAL files eligible for incremental backup is broken > ---------------------------------------------------------------- > > Key: HBASE-15094 > URL: https://issues.apache.org/jira/browse/HBASE-15094 > Project: HBase > Issue Type: Sub-task > Reporter: Vladimir Rodionov > Assignee: Vladimir Rodionov > Fix For: 2.0.0 > > > We should add to a selection WAL files which have been copied over by different backup sessions and which are newer than the most recent files processed for a given table. Currently, we look for WAL files only in a files system (WALs and OldWALs directories) > Scenario > Backup T1 > Backup T2 > add WAL1 > Backup T1 (WAL1 becomes eligible for deletion) > some time later > Backup T2 (WAL1 can be deleted by this time and won't get it into WAL file list for T2) -- This message was sent by Atlassian JIRA (v6.3.4#6332)