hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14450) HBase Backup/Restore Phase 3: Multiwal support
Date Wed, 10 Aug 2016 23:22:22 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416189#comment-15416189
] 

Ted Yu commented on HBASE-14450:
--------------------------------

Added more debug logging.
{code}
2016-08-10 15:46:16,306 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-2.1470869132540

2016-08-10 15:46:16,629 DEBUG [main] backup.TestIncrementalBackup(75): written 199 rows to
ns1:test-1470869129051
2016-08-10 15:46:16,633 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-3.1470869134197

2016-08-10 15:46:16,797 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496

2016-08-10 15:46:16,824 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1]
regionserver.LogRollBackupSubprocedure$RSRollLogTask(72): ++ DRPC started: 10.22.16.34,56228,1470869104167
2016-08-10 15:46:16,824 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1]
regionserver.LogRollBackupSubprocedurePool(84): Waiting for backup procedure to finish.
2016-08-10 15:46:16,824 INFO  [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1]
regionserver.LogRollBackupSubprocedure$RSRollLogTask(77): Trying to roll log in backup subprocedure,
current   log number: 1470869138221
2016-08-10 15:46:16,824 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |----rolllog
2016-08-10 15:46:16,825 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56228,1470869104167
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56226,1470869103454
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-abort
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-reached
2016-08-10 15:46:16,827 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1]
wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869176824
2016-08-10 15:46:16,827 DEBUG [main-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(238):
Ignoring created notification for node:/1/rolllog-proc/reached/rolllog
2016-08-10 15:46:16,829 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1]
wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869176825
2016-08-10 15:46:16,833 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869138221
2016-08-10 15:46:16,833 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869138221
2016-08-10 15:46:17,249 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496
2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1]
procedure.Subprocedure(188): Subprocedure 'rolllog' locally completed
2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1]
procedure.ZKProcedureMemberRpcs(269): Marking procedure  'rolllog' completed for member '10.22.16.
 34,56228,1470869104167' in zk
2016-08-10 15:46:17,250 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1]
impl.BackupSystemTable(254): write region server last roll log result to hbase:backup

2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(313): setting incr backup
file list
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.
34%2C56226%2C1470869103454.regiongroup-1.1470869108161
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.
34%2C56228%2C1470869104167.regiongroup-1.1470869110496
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.
34%2C56228%2C1470869104167.regiongroup-2.1470869132540
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.
34%2C56228%2C1470869104167.regiongroup-3.1470869134197
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56226%2C1470869103454.
  regiongroup-0.1470869138221
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56228%2C1470869104167.
  regiongroup-0.1470869138221
{code}
Tip of the snippet shows the WAL files written after full backup was taken.


> HBase Backup/Restore Phase 3: Multiwal support
> ----------------------------------------------
>
>                 Key: HBASE-14450
>                 URL: https://issues.apache.org/jira/browse/HBASE-14450
>             Project: HBase
>          Issue Type: Task
>    Affects Versions: 2.0.0
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>              Labels: backup
>             Fix For: 2.0.0
>
>
> We need to support multiwal configurations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message