Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 65DDD74A8 for ; Thu, 11 Aug 2011 18:47:02 +0000 (UTC) Received: (qmail 44766 invoked by uid 500); 11 Aug 2011 18:47:00 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 44718 invoked by uid 500); 11 Aug 2011 18:47:00 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 44710 invoked by uid 99); 11 Aug 2011 18:47:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Aug 2011 18:47:00 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jinsong_hu@hotmail.com designates 65.55.116.42 as permitted sender) Received: from [65.55.116.42] (HELO blu0-omc1-s31.blu0.hotmail.com) (65.55.116.42) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Aug 2011 18:46:51 +0000 Received: from BLU147-DS4 ([65.55.116.7]) by blu0-omc1-s31.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Thu, 11 Aug 2011 11:46:31 -0700 X-Originating-IP: [208.86.202.10] X-Originating-Email: [jinsong_hu@hotmail.com] Message-ID: From: "Jinsong Hu" To: Cc: "Search" References: <6C5C1804772DB944BA88A0DC48D338DA0B0FCF5B@dct-mail.sanjose.telcontar.com><6C5C1804772DB944BA88A0DC48D338DA0B0FD0C9@dct-mail.sanjose.telcontar.com> <6C5C1804772DB944BA88A0DC48D338DA0B0FD5D8@dct-mail.sanjose.telcontar.com> In-Reply-To: <6C5C1804772DB944BA88A0DC48D338DA0B0FD5D8@dct-mail.sanjose.telcontar.com> Subject: Re: corrupt .logs block Date: Thu, 11 Aug 2011 11:46:30 -0700 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 14.0.8117.416 X-MimeOLE: Produced By Microsoft MimeOLE V14.0.8117.416 X-OriginalArrivalTime: 11 Aug 2011 18:46:31.0090 (UTC) FILETIME=[FC571920:01CC5856] X-Virus-Checked: Checked by ClamAV on apache.org I run into same issue. I tried check_meta.rb --fix and add_table.rb, and still get the same hbck "inconsistent" table, however, I am able to do a rowcount for the table and there is no problem. Jimmy -------------------------------------------------- From: "Geoff Hendrey" Sent: Thursday, August 11, 2011 10:36 AM To: Cc: "Search" Subject: RE: corrupt .logs block > so I delete the corrpupt .logs files. OK, fine no more issue there. But a > handful of regions in a very large table (2000+ regions) are offline > (".META." says offline=true). > > How do I go about trying to get the region online, and how come restarting > hbase has no effect (region still offline). > > Tried 'hbck -fix', no effect. Hbck simply lists the table as > "inconsistent". > > Would appreciate any advice on how to resolve this. > > Thanks, > geoff > > -----Original Message----- > From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of Stack > Sent: Monday, August 08, 2011 4:25 PM > To: user@hbase.apache.org > Subject: Re: corrupt .logs block > > Well, if its a log no longer used, then you could just delete it. > That'll get rid of the fsck complaint (True, logs are not per table so > to be safe you'd need to flush all tables -- this would get all edits > that the log could be carrying out into the filesystem into hfiles). > > St.Ack > > On Mon, Aug 8, 2011 at 4:20 PM, Geoff Hendrey > wrote: >> Ah. Thanks for that. No, I don't need the log anymore. I am aware of how >> to flush a table from the hbase shell. But since the "fsck /" tells me a >> log file is corrupt, but not which table the corruption pertains to, >> does this mean I have to flush all my tables (I have a lot of tables). >> >> -geoff >> >> -----Original Message----- >> From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of >> Stack >> Sent: Monday, August 08, 2011 4:09 PM >> To: user@hbase.apache.org >> Subject: Re: corrupt .logs block >> >> On Sat, Aug 6, 2011 at 12:12 PM, Geoff Hendrey >> wrote: >>> I've got a corrupt HDFS block in a region server's ".logs" directory. >> >> You see this when you do hdfs fsck? Is the log still needed? You >> could do a flush across the cluster and that should do away with your >> dependency on this log. >> >> St.Ack >> >