Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5E240200C78 for ; Thu, 4 May 2017 02:20:08 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5CB7D160BBA; Thu, 4 May 2017 00:20:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A39D9160BB5 for ; Thu, 4 May 2017 02:20:07 +0200 (CEST) Received: (qmail 95544 invoked by uid 500); 4 May 2017 00:20:06 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 95533 invoked by uid 99); 4 May 2017 00:20:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 May 2017 00:20:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 4D3BDC191D for ; Thu, 4 May 2017 00:20:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id xhsOrGrrPy6T for ; Thu, 4 May 2017 00:20:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 0C36D5F1BA for ; Thu, 4 May 2017 00:20:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 590DCE06CF for ; Thu, 4 May 2017 00:20:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 1718A21DEC for ; Thu, 4 May 2017 00:20:04 +0000 (UTC) Date: Thu, 4 May 2017 00:20:04 +0000 (UTC) From: "Maddineni Sukumar (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-16466) HBase snapshots support in VerifyReplication tool to reduce load on live HBase cluster with large tables MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 04 May 2017 00:20:08 -0000 [ https://issues.apache.org/jira/browse/HBASE-16466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995943#comment-15995943 ] Maddineni Sukumar commented on HBASE-16466: ------------------------------------------- Hi [~zghaobac] , I added a condition in doCommandLine to check for this. User should provide all four peer snapshot related params or none. If user misses any one then we throw validation error saying all peer snapshot related parameters need to be provided. Below condition. + if (peerSnapshotName != null || peerSnapshotTmpDir != null || peerFSAddress != null + || peerHBaseRootAddress != null) { + if (peerSnapshotName == null || peerSnapshotTmpDir == null || peerFSAddress == null + || peerHBaseRootAddress == null) { + printUsage( + "Peer snapshot name, peer snapshot temp location, Peer HBase root address and " + + "peer FSAddress should be provided to use snapshots in peer cluster"); + return false; + } + } > HBase snapshots support in VerifyReplication tool to reduce load on live HBase cluster with large tables > -------------------------------------------------------------------------------------------------------- > > Key: HBASE-16466 > URL: https://issues.apache.org/jira/browse/HBASE-16466 > Project: HBase > Issue Type: Improvement > Components: hbase > Affects Versions: 0.98.21 > Reporter: Sukumar Maddineni > Assignee: Maddineni Sukumar > Fix For: 2.0.0 > > Attachments: HBASE-16466.branch-1.3.001.patch, HBASE-16466.v1.patch, HBASE-16466.v2.patch, HBASE-16466.v3.patch, HBASE-16466.v4.patch, HBASE-16466.v5.patch > > > As of now VerifyReplicatin tool is running using normal HBase scanners. If you want to run VerifyReplication multiple times on a production live cluster with large tables then it creates extra load on HBase layer. So if we implement snapshot based support then both in source and target we can read data from snapshots which reduces load on HBase -- This message was sent by Atlassian JIRA (v6.3.15#6346)