hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Hu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-18806) VerifyRep by snapshot need not to restore snapshot for each mapper
Date Wed, 13 Sep 2017 11:30:00 GMT
Zheng Hu created HBASE-18806:
--------------------------------

             Summary: VerifyRep by snapshot need not to restore snapshot for each mapper
                 Key: HBASE-18806
                 URL: https://issues.apache.org/jira/browse/HBASE-18806
             Project: HBase
          Issue Type: Bug
          Components: Replication
    Affects Versions: 2.0.0-alpha-2
            Reporter: Zheng Hu
            Assignee: Zheng Hu


In following method stack,  seems like each mapper task will restore the snapshot.   If we
verify replication  by a snapshot which has many hfiles,  then we will take long time to restore
snapshot.   In our  cluster,   we took ~30min for the snapshot restoring when verify a big
table.

{code}

Verifier.map
    |-------->  replicatedScanner = new TableSnapshotScanner(...)
                                                                |-------->  TableSnapshotScanner.init()
                                                                                         
|-----> RestoreSnapshotHelper.copySnapshotForScanner
{code} 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message