Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6B11B200B6B for ; Thu, 11 Aug 2016 01:22:25 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 69E72160AA4; Wed, 10 Aug 2016 23:22:25 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 88FE8160AB1 for ; Thu, 11 Aug 2016 01:22:24 +0200 (CEST) Received: (qmail 71606 invoked by uid 500); 10 Aug 2016 23:22:23 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 71591 invoked by uid 99); 10 Aug 2016 23:22:23 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Aug 2016 23:22:23 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 78AB52C02A1 for ; Wed, 10 Aug 2016 23:22:22 +0000 (UTC) Date: Wed, 10 Aug 2016 23:22:22 +0000 (UTC) From: "Ted Yu (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-14450) HBase Backup/Restore Phase 3: Multiwal support MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 10 Aug 2016 23:22:25 -0000 [ https://issues.apache.org/jira/browse/HBASE-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416189#comment-15416189 ] Ted Yu commented on HBASE-14450: -------------------------------- Added more debug logging. {code} 2016-08-10 15:46:16,306 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-2.1470869132540 2016-08-10 15:46:16,629 DEBUG [main] backup.TestIncrementalBackup(75): written 199 rows to ns1:test-1470869129051 2016-08-10 15:46:16,633 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-3.1470869134197 2016-08-10 15:46:16,797 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496 2016-08-10 15:46:16,824 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] regionserver.LogRollBackupSubprocedure$RSRollLogTask(72): ++ DRPC started: 10.22.16.34,56228,1470869104167 2016-08-10 15:46:16,824 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] regionserver.LogRollBackupSubprocedurePool(84): Waiting for backup procedure to finish. 2016-08-10 15:46:16,824 INFO [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] regionserver.LogRollBackupSubprocedure$RSRollLogTask(77): Trying to roll log in backup subprocedure, current log number: 1470869138221 2016-08-10 15:46:16,824 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |----rolllog 2016-08-10 15:46:16,825 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56228,1470869104167 2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56226,1470869103454 2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-abort 2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-reached 2016-08-10 15:46:16,827 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1] wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869176824 2016-08-10 15:46:16,827 DEBUG [main-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(238): Ignoring created notification for node:/1/rolllog-proc/reached/rolllog 2016-08-10 15:46:16,829 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869176825 2016-08-10 15:46:16,833 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869138221 2016-08-10 15:46:16,833 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869138221 2016-08-10 15:46:17,249 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496 2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] procedure.Subprocedure(188): Subprocedure 'rolllog' locally completed 2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] procedure.ZKProcedureMemberRpcs(269): Marking procedure 'rolllog' completed for member '10.22.16. 34,56228,1470869104167' in zk 2016-08-10 15:46:17,250 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1] impl.BackupSystemTable(254): write region server last roll log result to hbase:backup 2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(313): setting incr backup file list 2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16. 34%2C56226%2C1470869103454.regiongroup-1.1470869108161 2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-1.1470869110496 2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-2.1470869132540 2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-3.1470869134197 2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56226%2C1470869103454. regiongroup-0.1470869138221 2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56228%2C1470869104167. regiongroup-0.1470869138221 {code} Tip of the snippet shows the WAL files written after full backup was taken. > HBase Backup/Restore Phase 3: Multiwal support > ---------------------------------------------- > > Key: HBASE-14450 > URL: https://issues.apache.org/jira/browse/HBASE-14450 > Project: HBase > Issue Type: Task > Affects Versions: 2.0.0 > Reporter: Vladimir Rodionov > Assignee: Vladimir Rodionov > Labels: backup > Fix For: 2.0.0 > > > We need to support multiwal configurations. -- This message was sent by Atlassian JIRA (v6.3.4#6332)