hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maddineni Sukumar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16466) HBase snapshots support in VerifyReplication tool to reduce load on live HBase cluster with large tables
Date Thu, 27 Apr 2017 20:37:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15987608#comment-15987608
] 

Maddineni Sukumar commented on HBASE-16466:
-------------------------------------------

Hi Ted, 

In my local setup I tried with HBase 0.98 , HBase 1.3 with Hadoop 2.7.3 and its passing(thats
our setup :(). 
When I try with Hadoop 2.5.1 which is default configured with HBase 1.3 it is failing with
not able to find jar error 
"java.io.FileNotFoundException: File does not exist: hdfs://localhost:51085/Users/smaddineni/.m2/repository/org/apache/hbase/hbase-common/1.3.1/hbase-common-1.3.1.jar"

I am looking into it. I tried by not calling addTableCoprocessorJarsToClasspath() and still
no luck.

> HBase snapshots support in VerifyReplication tool to reduce load on live HBase cluster
with large tables
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-16466
>                 URL: https://issues.apache.org/jira/browse/HBASE-16466
>             Project: HBase
>          Issue Type: Improvement
>          Components: hbase
>    Affects Versions: 0.98.21
>            Reporter: Sukumar Maddineni
>            Assignee: Maddineni Sukumar
>             Fix For: 1.3.1
>
>         Attachments: HBASE-16466.branch-1.3.001.patch
>
>
> As of now VerifyReplicatin tool is running using normal HBase scanners. If you  want
to run VerifyReplication multiple times on a production live cluster with large tables then
it creates extra load on HBase layer. So if we implement snapshot based support then both
in source and target we can read data from snapshots which reduces load on HBase



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message