Return-Path: Delivered-To: apmail-hbase-user-archive@www.apache.org Received: (qmail 75130 invoked from network); 19 Oct 2010 04:24:41 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 19 Oct 2010 04:24:41 -0000 Received: (qmail 65570 invoked by uid 500); 19 Oct 2010 04:24:39 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 65541 invoked by uid 500); 19 Oct 2010 04:24:39 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 65131 invoked by uid 99); 19 Oct 2010 04:24:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Oct 2010 04:24:38 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates 74.125.82.169 as permitted sender) Received: from [74.125.82.169] (HELO mail-wy0-f169.google.com) (74.125.82.169) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Oct 2010 04:24:32 +0000 Received: by wyf28 with SMTP id 28so2146057wyf.14 for ; Mon, 18 Oct 2010 21:24:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:sender:received :in-reply-to:references:date:x-google-sender-auth:message-id:subject :from:to:content-type:content-transfer-encoding; bh=fEMKl9ff9hiAvfzvehPapFTC2/Vp8d7SsaahVtMlof8=; b=RFqQ14P6nWGA5HqigSAYMmD9KxJ5sBxXglU6i2t2i4d9ALS9p0uJHRgDqaYH/eJzsa UK89MW/A8aDOwRIJZ+cJIsrxjHy/8YJml4yu0E0rw1pk9cWXmNNnpb8byUWQvGIpxvvn ZVsKyb0RtngveNk4+b229xMGT9DUx3AullDIE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=HgE3d6lArxfQ9D4yoUUvNUmrL0OzuCzM/tDwjIfpcEaUDniMwUNsC/qCWoaXGNAeD0 UWZAP62xrkAdPCVubPErI/FokdJEMsOxEAKoNIDaQczqd0ovNTgh4CJwYFdaTSzaqPX0 6UoQstz5TxBVNIbpRbFiBC2Iba6mkcm+3r3D0= MIME-Version: 1.0 Received: by 10.227.134.210 with SMTP id k18mr2803713wbt.160.1287462252102; Mon, 18 Oct 2010 21:24:12 -0700 (PDT) Sender: saint.ack@gmail.com Received: by 10.216.45.74 with HTTP; Mon, 18 Oct 2010 21:24:11 -0700 (PDT) In-Reply-To: References: <8953A2D1-4CDF-4223-A9E4-325FB6C5CA10@gmail.com> Date: Mon, 18 Oct 2010 21:24:11 -0700 X-Google-Sender-Auth: _n4a_YCNrRiajpNZMGkL7SVfdNI Message-ID: Subject: Re: two same regions on two diff. regionservers From: Stack To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Is it complaining of one region only? Can you confirm it is indeed on two servers? (Grep its name in master logs and see if it got assigned two). If you look in list of regions on master ui page, where does it think it is? Is it there? If so, try killing the other regionserver. This should be fixed in TRUNK. You might try moving to 09/24 too. St.Ack On Mon, Oct 18, 2010 at 9:12 PM, Jack Levin wrote: > 830, I did restart, and I still have this: > > 10/10/18 21:12:22 DEBUG client.HConnectionManager$TableServers: Cached > location for .META.,,1.1028785192 is mtae9.prod.imageshack.com:60020 > ................................................Exception in thread > "main" java.io.IOException: Two entries in META are same REGION =3D> > {NAME =3D> 'img530,paracomplaceralgay.png,1287419125193.f4a2462ad7f9d5f5e= c3bfff05df842e6.', > STARTKEY =3D> 'paracomplaceralgay.png', ENDKEY =3D> 'qqcy.jpg', ENCODED = =3D> > f4a2462ad7f9d5f5ec3bfff05df842e6, TABLE =3D> {{NAME =3D> 'img530', > FAMILIES =3D> [{NAME =3D> 'att', BLOOMFILTER =3D> 'NONE', VERSIONS =3D> '= 3', > COMPRESSION =3D> 'NONE', TTL =3D> '2147483647', BLOCKSIZE =3D> '350000', > IN_MEMORY =3D> 'false', BLOCKCACHE =3D> 'true'}]}} > > > -Jack > > On Mon, Oct 18, 2010 at 9:10 PM, Stack wrote: >> Have you restarted recently? =A0Which version you at now Jack? =A0Are yo= u on 0924? >> St.Ack >> >> On Mon, Oct 18, 2010 at 12:35 PM, Jack Levin wrote: >>> it knows the regions, just not the servers where they are. >>> >>> >>> >>> On Mon, Oct 18, 2010 at 10:55 AM, Stack wrote: >>>> Try >>>> >>>> hbase> close_region 'NAME' 'HOSTNAME' >>>> >>>> Do help, it'll show you the exact syntax. >>>> >>>> It might not work though. =A0You might get NPE IIRC. >>>> >>>> Did hbsck identify all doubled regions? >>>> >>>> St.Ack >>>> >>>> On Mon, Oct 18, 2010 at 10:49 AM, Jack Levin wrote= : >>>>> Also, check this out: >>>>> >>>>> ................................................Exception in thread >>>>> "main" java.io.IOException: Two entries in META are same REGION =3D> >>>>> {NAME =3D> 'img530,paracomplaceralgay.png,1287419125193.f4a2462ad7f9d= 5f5ec3bfff05df842e6.', >>>>> STARTKEY =3D> 'paracomplaceralgay.png', ENDKEY =3D> 'qqcy.jpg', ENCOD= ED =3D> >>>>> f4a2462ad7f9d5f5ec3bfff05df842e6, TABLE =3D> {{NAME =3D> 'img530', >>>>> FAMILIES =3D> [{NAME =3D> 'att', BLOOMFILTER =3D> 'NONE', VERSIONS = =3D> '3', >>>>> COMPRESSION =3D> 'NONE', TTL =3D> '2147483647', BLOCKSIZE =3D> '35000= 0', >>>>> IN_MEMORY =3D> 'false', BLOCKCACHE =3D> 'true'}]}} >>>>> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.HBaseFsck$1.processR= ow(HBaseFsck.java:422) >>>>> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.MetaScanner.metaScan= (MetaScanner.java:156) >>>>> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.MetaScanner.metaScan= (MetaScanner.java:68) >>>>> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.MetaScanner.metaScan= (MetaScanner.java:53) >>>>> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.HBaseFsck.getMetaEnt= ries(HBaseFsck.java:437) >>>>> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.HBaseFsck.doWork(HBa= seFsck.java:105) >>>>> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.HBaseFsck.main(HBase= Fsck.java:523) >>>>> >>>>> >>>>> How do I find the region to close that is not listed in Meta? >>>>> >>>>> -Jack >>>>> >>>>> On Sun, Oct 17, 2010 at 10:36 PM, Jack Levin wrot= e: >>>>>> Is there automatic repair proggy that could do that? I got 109 entri= es like that >>>>>> >>>>>> -Jack >>>>>> >>>>>> >>>>>> On Oct 17, 2010, at 9:42 PM, Ryan Rawson wrote: >>>>>> >>>>>>> In the shell try the close_region "region_name", "server" for the o= ne >>>>>>> that is _not_ listed in the META table (visible on the master table >>>>>>> page). >>>>>>> >>>>>>> ie: you are telling the regionserver that should not have the regio= n >>>>>>> to close it. >>>>>>> >>>>>>> -ryan >>>>>>> >>>>>>> On Sun, Oct 17, 2010 at 9:36 PM, Jack Levin wro= te: >>>>>>>> please see: >>>>>>>> http://pastebin.com/4PrUstmy >>>>>>>> >>>>>>>> What is the right course of action to resolve this? >>>>>>>> >>>>>>>> -Jack >>>>>>>> >>>>>> >>>>> >>>> >>> >> >