Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 50F7C1025D for ; Tue, 29 Oct 2013 03:47:04 +0000 (UTC) Received: (qmail 63458 invoked by uid 500); 29 Oct 2013 03:47:00 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 63305 invoked by uid 500); 29 Oct 2013 03:46:56 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 63258 invoked by uid 99); 29 Oct 2013 03:46:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Oct 2013 03:46:55 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of vrodionov@carrieriq.com designates 204.235.122.22 as permitted sender) Received: from [204.235.122.22] (HELO obmail.carrieriq.com) (204.235.122.22) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Oct 2013 03:46:51 +0000 From: Vladimir Rodionov To: "user@hbase.apache.org" Date: Mon, 28 Oct 2013 20:44:34 -0700 Subject: RE: HBase wont responding when one region server goes down Thread-Topic: HBase wont responding when one region server goes down Thread-Index: Ac7UWDFrR1BrtMUdSYiBTPmZrYfTEgAAP1OS Message-ID: References: ,, In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Google "HBase MTTR improvements in 0.96". 10-15 minutes of downtime is norm= al on versions prior to 0.96 with default HBase configuration settings. Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodionov@carrieriq.com ________________________________________ From: Sandeep L [sandeepvreddy@outlook.com] Sent: Monday, October 28, 2013 8:36 PM To: user@hbase.apache.org Subject: RE: HBase wont responding when one region server goes down @Jean-mar We are using HBase-0.94.1 with Hadoop-1.0.2.We have 15 Region servers, 5 Zo= okeepers, 1 master, 3 backup masters and & 18 Dtatnodes.Our Java version is= "jdk1.7.0_04" The issue is whenever a region server is down scan/get is not working. Thanks,Sandeep. > From: jean-marc@spaggiari.org > Date: Mon, 28 Oct 2013 15:55:31 -0400 > Subject: Re: HBase wont responding when one region server goes down > To: user@hbase.apache.org > > Hi Sandeep, > > Do you have more information regarding your cluster? Number of nodes, > hadoop version, what is "not responding", etc.? > > Thanks, > > JM > > > 2013/10/28 Asaf Mesika > > > If your query (scan) needs a region on the failed region server, the cl= ient > > will fail and silently retry about 10 times. The sleep time increase as > > each retry fails and can reach 10min. On the server side, the master ta= kes > > 3min to realize the RS failed thus issue a region move, which might tak= e a > > few minutes, which together explain the 10min query failure period > > > > On Monday, October 28, 2013, Sandeep L wrote: > > > > > Hi, > > > We are using HBase 0.94.1. > > > We are facing a strange issue form long time not at got any proper > > > solution. > > > Here is the issue:Whenever one region server in cluster goes down, wh= ole > > > HBase wont respond for some time (around 5 to 10 minutes).We are unab= le > > to > > > get any clue about the issue. > > > > > > Can some help us to resolve this issue. > > > > > > Thanks,Sandeep. > > Confidentiality Notice: The information contained in this message, includi= ng any attachments hereto, may be confidential and is intended to be read o= nly by the individual or entity to whom this message is addressed. If the r= eader of this message is not the intended recipient or an agent or designee= of the intended recipient, please note that any review, use, disclosure or= distribution of this message or its attachments, in any form, is strictly = prohibited. If you have received this message in error, please immediately= notify the sender and/or Notifications@carrieriq.com and delete or destroy= any copy of this message and its attachments.