hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming
Date Wed, 21 Sep 2016 21:42:20 GMT
Ted Yu created HBASE-16672:

             Summary: Add option for bulk load to copy hfile(s) instead of renaming
                 Key: HBASE-16672
                 URL: https://issues.apache.org/jira/browse/HBASE-16672
             Project: HBase
          Issue Type: Improvement
            Reporter: Ted Yu

While working on HBASE-14417, I found that taking full backup of table which received bulk
loaded hfiles and later gone through incremental restore failed with the following exception:
2016-09-21 11:33:06,340 WARN  [member: ',53915,1474482617015' subprocedure-pool7-thread-1]
snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(347): Got Exception in SnapshotSubprocedurePool
java.util.concurrent.ExecutionException: java.io.FileNotFoundException: File does not exist:
  at java.util.concurrent.FutureTask.report(FutureTask.java:122)
  at java.util.concurrent.FutureTask.get(FutureTask.java:192)
  at org.apache.hadoop.hbase.regionserver.snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool.waitForOutstandingTasks(RegionServerSnapshotManager.java:323)
  at org.apache.hadoop.hbase.regionserver.snapshot.FlushSnapshotSubprocedure.flushSnapshot(FlushSnapshotSubprocedure.java:139)
  at org.apache.hadoop.hbase.regionserver.snapshot.FlushSnapshotSubprocedure.insideBarrier(FlushSnapshotSubprocedure.java:159)
The cause was that the bulk loaded hfiles were renamed during bulk load step of incremental

To support incrementally restoring to multiple destinations, this issue adds option which
would always copy hfile(s) during bulk load.

This message was sent by Atlassian JIRA

View raw message