hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-10914) Improve the snapshot directory local copy during ExportSnapshot
Date Sat, 05 Apr 2014 02:40:14 GMT
Harsh J created HBASE-10914:
-------------------------------

             Summary: Improve the snapshot directory local copy during ExportSnapshot
                 Key: HBASE-10914
                 URL: https://issues.apache.org/jira/browse/HBASE-10914
             Project: HBase
          Issue Type: Bug
          Components: snapshots
    Affects Versions: 0.96.0
            Reporter: Harsh J
            Priority: Minor


For tables with a lot of regions, the ExportSnapshot appears to "hang" without progress cause
it copies the .snapshot directory (which has tiny, reference/reference-like files I assume)
and does not report its state. Would be good if it dumped its state for like say, every 50
files it copies.

This operation is also sequential, so takes a lot of time, and can be improved to do 5-10
threads at a time in parallel perhaps, since the actual writes are tiny (i.e. data transfer
is no concern) and its mostly just NN interaction that's needed here.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message