Return-Path: Delivered-To: apmail-hadoop-hbase-user-archive@minotaur.apache.org Received: (qmail 84426 invoked from network); 18 Mar 2009 12:45:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 18 Mar 2009 12:45:32 -0000 Received: (qmail 36493 invoked by uid 500); 18 Mar 2009 12:45:31 -0000 Delivered-To: apmail-hadoop-hbase-user-archive@hadoop.apache.org Received: (qmail 36473 invoked by uid 500); 18 Mar 2009 12:45:31 -0000 Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-user@hadoop.apache.org Delivered-To: mailing list hbase-user@hadoop.apache.org Received: (qmail 36462 invoked by uid 99); 18 Mar 2009 12:45:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Mar 2009 05:45:31 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jdcryans@gmail.com designates 74.125.44.29 as permitted sender) Received: from [74.125.44.29] (HELO yx-out-2324.google.com) (74.125.44.29) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Mar 2009 12:45:24 +0000 Received: by yx-out-2324.google.com with SMTP id 3so20912yxj.29 for ; Wed, 18 Mar 2009 05:45:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type:content-transfer-encoding; bh=HPBGaopAvI0e0qUj0Wkn960INR+zMsZ4Gu6b0WK14uE=; b=teQXsA23WEr0NzLMHs08LLSKqx+mIAyS5N5Q9SEtyfAW8FJuVbll+Wjs2uR4U0cLj8 CEUE86wD9Ji1PTAaLb3rX9STGUC5NLmIjKrOd6H3B/sJQIIJXDSMcpAHnpH+GOLHQ+p1 XyxwjRmmfBpIcw9BdzQdPlURjeWrHJI6fPXA4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=mw3aTMsn76+Q69Emk/644ozHUkFAeQ9aEqH80WtWcA41gKQ7PhQmqQMMU0O2OoMNyQ XzgdZH5NAW3buqdrXWFDSrIDvg+eKvz6yhvKlcIYc4m2S5zNVqvhZ+XlyIMmv40ZJx+z grfEZMdTR9GHix/uCkeTohA3Zk95QngY+kip0= MIME-Version: 1.0 Sender: jdcryans@gmail.com Received: by 10.151.44.14 with SMTP id w14mr2171371ybj.203.1237380303948; Wed, 18 Mar 2009 05:45:03 -0700 (PDT) In-Reply-To: <2f81e00903180100u3bb14460jfe78bc913ad191d5@mail.gmail.com> References: <2f81e00903180100u3bb14460jfe78bc913ad191d5@mail.gmail.com> Date: Wed, 18 Mar 2009 08:45:03 -0400 X-Google-Sender-Auth: e0e9d5b940f40f22 Message-ID: <31a243e70903180545j5114b4ay52028b248dcd0336@mail.gmail.com> Subject: Re: Has anybody run into NotServingRegionException ? From: Jean-Daniel Cryans To: hbase-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Michael, This is normal when not followed by RetriesExhausted exceptions. That exception is used by the region servers to tell the clients that a certain region was moved (because of rebalancing or splitting) and that they should refresh their cache. J-D On Wed, Mar 18, 2009 at 4:00 AM, Michael Dagaev wrote: > Hi all > > =A0 =A0We run a small Hbase 0.18 cluster (4 machines). > A few days ago the traffic (mostly writes) increased > and we started to notice NotServingRegionExceptions. > > Has anybody run into such a problem ? > > org.apache.hadoop.hbase.NotServingRegionException: Region <...> =A0closed > =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowL= ock(HRegion.java:1810) > =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HR= egion.java:1875) > =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.regionserver.HRegion.batchUpdat= e(HRegion.java:1406) > =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.regionserver.HRegion.batchUpdat= e(HRegion.java:1380) > =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.regionserver.HRegionServer.batc= hUpdate(HRegionServer.java:1114) > =A0 =A0 =A0 =A0at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Sou= rce) > =A0 =A0 =A0 =A0at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegat= ingMethodAccessorImpl.java:25) > =A0 =A0 =A0 =A0at java.lang.reflect.Method.invoke(Method.java:597) > =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseR= PC.java:554) > =A0 =A0 =A0 =A0at org.apache.hadoop.ipc.Server$Handler.run(Server.java:88= 8) > > Thank =A0you for your cooperation, > M. > > P.S. Yes, we are going to upgrade our cluster to Hbase 0.19 >