Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@locus.apache.org Received: (qmail 48806 invoked from network); 10 Sep 2008 18:50:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 10 Sep 2008 18:50:00 -0000 Received: (qmail 8434 invoked by uid 500); 10 Sep 2008 18:49:57 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 8421 invoked by uid 500); 10 Sep 2008 18:49:57 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 8410 invoked by uid 99); 10 Sep 2008 18:49:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Sep 2008 11:49:56 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jim@powerset.com designates 207.5.72.95 as permitted sender) Received: from [207.5.72.95] (HELO EXHUB015-3.exch015.msoutlookonline.net) (207.5.72.95) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Sep 2008 18:48:58 +0000 Received: from EXVMBX015-1.exch015.msoutlookonline.net ([207.5.72.71]) by EXHUB015-3.exch015.msoutlookonline.net ([207.5.72.95]) with mapi; Wed, 10 Sep 2008 11:49:29 -0700 From: Jim Kellerman To: "hbase-dev@hadoop.apache.org" Date: Wed, 10 Sep 2008 11:49:36 -0700 Subject: RE: Hbase corrupts data after reporting MSG_REPORT_CLOSE to master during compaction and split process Thread-Topic: Hbase corrupts data after reporting MSG_REPORT_CLOSE to master during compaction and split process Thread-Index: AckOr2XxO4dK0MdsTBuS3PrA0W8QeAD2GC9bAAH6wKAABdQXWwAAXWMQAAB1K3gAACYjEAAJb6O8ACfJirMAAN+QYA== Message-ID: <84E2AE771361E9419DD0EFBD31F09C4D4F654B2A47@EXVMBX015-1.exch015.msoutlookonline.net> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org > -----Original Message----- > From: Cosmin Lehene [mailto:clehene@adobe.com] > Sent: Wednesday, September 10, 2008 11:05 AM > To: hbase-dev@hadoop.apache.org > Subject: Re: Hbase corrupts data after reporting MSG_REPORT_CLOSE to mast= er > during compaction and split process > > Just to follow up on the discussion. > > I pasted the logs in the wrong order. There's a lease expired entry follo= wed > by a process server shutdown log entry. > > It appears that the region assignment is caused by > ProcessServerShutdown.scanMetaRegion() Yes it is caused by ProcessServerShutdown.scanMetaRegion() but the reason it gets reassigned is farther up in the method: } else { // Get region reassigned regions.add(info); There is no check to see if the region is offline or split. This is definitely a bug. The log file snippets helped quite a lot. Entered Jira HBASE-881. Thanks Cosmin!