hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16466) HBase snapshots support in VerifyReplication tool to reduce load on live HBase cluster with large tables
Date Wed, 03 May 2017 21:49:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995748#comment-15995748
] 

Andrew Purtell commented on HBASE-16466:
----------------------------------------

I will commit this to master. 

Would you like to post a patch here for branch-1 [~sukunaidu@gmail.com]? I did try to pick
this back. There were some fixups needed and then TestReplicationSmallTests would not pass,
something to do with filesystems and job configuration. So no auto-backport, sorry. 


> HBase snapshots support in VerifyReplication tool to reduce load on live HBase cluster
with large tables
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-16466
>                 URL: https://issues.apache.org/jira/browse/HBASE-16466
>             Project: HBase
>          Issue Type: Improvement
>          Components: hbase
>    Affects Versions: 0.98.21
>            Reporter: Sukumar Maddineni
>            Assignee: Maddineni Sukumar
>             Fix For: 2.0.0
>
>         Attachments: HBASE-16466.branch-1.3.001.patch, HBASE-16466.v1.patch, HBASE-16466.v2.patch,
HBASE-16466.v3.patch, HBASE-16466.v4.patch, HBASE-16466.v5.patch
>
>
> As of now VerifyReplicatin tool is running using normal HBase scanners. If you  want
to run VerifyReplication multiple times on a production live cluster with large tables then
it creates extra load on HBase layer. So if we implement snapshot based support then both
in source and target we can read data from snapshots which reduces load on HBase



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message