hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14450) HBase Backup/Restore Phase 3: Multiwal support
Date Thu, 18 Aug 2016 21:10:21 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15427154#comment-15427154
] 

Ted Yu commented on HBASE-14450:
--------------------------------

Looking at a failed run:
{code}
2016-08-18 13:19:05,088 DEBUG [sync.4] wal.FSHLog$SyncRunner(1277): syncing writer hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/WALs/10.22.9.171,57156,
      1471551472681/10.22.9.171%2C57156%2C1471551472681.regiongroup-2.1471551508287
2016-08-18 13:19:05,092 DEBUG [sync.0] wal.FSHLog$SyncRunner(1277): syncing writer hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/WALs/10.22.9.171,57156,
      1471551472681/10.22.9.171%2C57156%2C1471551472681.regiongroup-2.1471551508287
...
2016-08-18 13:19:07,613 DEBUG [ProcedureExecutor-5] mapreduce.MapReduceBackupCopyService(318):
DistCp options: [hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/
WALs/10.22.9.171,57154,1471551472088/10.22.9.171%2C57154%2C1471551472088.regiongroup-1.1471551477138,
hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/WALs/10.22.9.171,57156,1471551472681/10.22.9.171%2C57156%2C1471551472681.regiongroup-1.1471551479268,
hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/oldWALs/10.22.9.
     171%2C57154%2C1471551472088.regiongroup-0.1471551507020, hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/oldWALs/10.22.9.171%2C57156%2C1471551472681.regiongroup-0.1471551507020,
hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/oldWALs/10.22.9.171%2C57156%2C1471551472681.regiongroup-2.1471551501643,
hdfs://localhost:57146/user/tyu/test-data/7a216f31-59f4-462a-9041-1c4ab7411846/oldWALs/10.22.9.171%2C57156%2C1471551472681.regiongroup-3.1471551503093,
hdfs://localhost:57146/backupUT/backup_1471551545295/WALs]
{code}
The wal file being written to (additional rows) didn't appear in the list of files to be copied
by distcp.

> HBase Backup/Restore Phase 3: Multiwal support
> ----------------------------------------------
>
>                 Key: HBASE-14450
>                 URL: https://issues.apache.org/jira/browse/HBASE-14450
>             Project: HBase
>          Issue Type: Task
>    Affects Versions: 2.0.0
>            Reporter: Vladimir Rodionov
>            Assignee: Ted Yu
>              Labels: backup
>             Fix For: 2.0.0
>
>         Attachments: 14450-roll.v2.txt, 14450.roll-wait.txt, 14450.v2.txt, org.apache.hadoop.hbase.backup.TestIncrementalBackup-output.txt,
testIncrementalBackup-8-15.txt, testIncrementalBackup-succ.txt
>
>
> We need to support multiwal configurations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message