hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11185) Parallelize Snapshot operations
Date Wed, 21 May 2014 05:51:43 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004393#comment-14004393
] 

Hudson commented on HBASE-11185:
--------------------------------

SUCCESS: Integrated in HBase-TRUNK #5135 (See [https://builds.apache.org/job/HBase-TRUNK/5135/])
HBASE-11185 Parallelize Snapshot operations (mbertozzi: rev 1596168)
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/DisabledTableSnapshotHandler.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/MasterSnapshotVerifier.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileInfo.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/RestoreSnapshotHelper.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotInfo.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotManifest.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotManifestV2.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotReferenceUtil.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/ModifyRegionUtils.java


> Parallelize Snapshot operations
> -------------------------------
>
>                 Key: HBASE-11185
>                 URL: https://issues.apache.org/jira/browse/HBASE-11185
>             Project: HBase
>          Issue Type: Bug
>          Components: snapshots
>    Affects Versions: 0.99.0
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>             Fix For: 0.99.0
>
>         Attachments: HBASE-11185-v0.patch
>
>
> when SnapshotInfo or snapshot verification is executed against a remote path, it may
takes a while since all the code is mainly composed by sequential calls to the fs.
> This patch will parallelize all the snapshot operations using a thread pool to dispatch
requests. The size of the pool is tunable by using  "hbase.snapshot.thread.pool.max"



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message