Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 83A79109FE for ; Mon, 28 Oct 2013 22:33:39 +0000 (UTC) Received: (qmail 36820 invoked by uid 500); 28 Oct 2013 22:33:37 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 36748 invoked by uid 500); 28 Oct 2013 22:33:37 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 36740 invoked by uid 99); 28 Oct 2013 22:33:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Oct 2013 22:33:37 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates 209.85.215.45 as permitted sender) Received: from [209.85.215.45] (HELO mail-la0-f45.google.com) (209.85.215.45) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Oct 2013 22:33:30 +0000 Received: by mail-la0-f45.google.com with SMTP id hp15so5721834lab.4 for ; Mon, 28 Oct 2013 15:33:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=XihtePGGmyIF65GbpLgM3yzSPc16cHWRTIISfMGg1+A=; b=GFwa2AGExGbcd8AoSsRb2Xm1pSS/nJxXvlyb1lI1LzjFJnZmmySd8X+AWlyOTErtGY Z9Kf7GcPek/480HT56vbg3i/kW5u/cyZsAYWQLo4W9RGY9GaBP4wD4L4cJm6g2hCEJx7 Pj+IuK6ecrPIVWMHbKNm19YwKB4hH8v1N77uVDc9VpzjdHZOHWLnKgU6xuBVW1XOCzx0 h/YlSaIBF8OeQGPVh8EH71P39aPsknD26rJ/cuUPe1uHs7aOhtOZ6Z0nmqH2gxMNIe3/ JYQpc9Yq/vTrC8xqjdr9OFgHlz0g5QDGnpwX2vyvUwcbXvHAHHlTG+NTboZ7PC0rGVWs qbiQ== MIME-Version: 1.0 X-Received: by 10.152.87.79 with SMTP id v15mr12392077laz.14.1382999589897; Mon, 28 Oct 2013 15:33:09 -0700 (PDT) Received: by 10.112.129.40 with HTTP; Mon, 28 Oct 2013 15:33:09 -0700 (PDT) In-Reply-To: References: Date: Mon, 28 Oct 2013 15:33:09 -0700 Message-ID: Subject: Re: HBase Replication Questions From: Ted Yu To: "user@hbase.apache.org" Content-Type: multipart/alternative; boundary=001a11c242e847cb7c04e9d4af8f X-Virus-Checked: Checked by ClamAV on apache.org --001a11c242e847cb7c04e9d4af8f Content-Type: text/plain; charset=ISO-8859-1 Please see also 'Replication Metrics' at the bottom of http://hbase.apache.org/replication.html On Mon, Oct 28, 2013 at 3:23 PM, hdev ml wrote: > Thanks Demai. Need to find out how to access HBase metrics. > > But thanks for your insights. > Harshad > > > On Mon, Oct 28, 2013 at 2:45 PM, Demai Ni wrote: > > > 1) you can use replication metrics info such as:ageOfLastShippedOp, > > timeStampsOfLastShippedOp, sizeOfLogQueue ageOfLastAppliedOp, and > > timeStampsOfLastAppliedOp to figure out the lag. > > 2) with my best knowledge, the replication won't be together with > snapshot. > > That is the peers won't know there is a restore occurred on primary. So a > > user must take care it manually. the VerifyReplication tool may be > > helpful to identify which data (boundary by timestamps) is mismatch, so > the > > copyTable doesn't have to copy the whole table > > > > Demai > > > > Demai > > > > > > On Mon, Oct 28, 2013 at 12:07 PM, hdev ml wrote: > > > > > Hello all, > > > > > > I have a couple of questions for HBase. > > > > > > 1. Is there any way to find out by how much time the replication is > > lagging > > > on the peer cluster or even primary cluster is ok. > > > 2. Say replication is going on for some time for a table and then you > > > restore a snapshot on the Primary. Would replication catch up with the > > > restore snapshot? Or do I have to treat that as replicating from > scratch, > > > meaning > > > > > > 1. disable peer > > > 2. restore snapshot on primary > > > 3. copyTable upto disable timestamp > > > 4. enable peer > > > > > > > > > Any help is appreciated. > > > > > > Thanks > > > > > > Harshad > > > > > > --001a11c242e847cb7c04e9d4af8f--