Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 20874 invoked from network); 17 Jan 2008 22:54:56 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 17 Jan 2008 22:54:56 -0000 Received: (qmail 92542 invoked by uid 500); 17 Jan 2008 22:54:45 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 92503 invoked by uid 500); 17 Jan 2008 22:54:45 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 92493 invoked by uid 99); 17 Jan 2008 22:54:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jan 2008 14:54:44 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jan 2008 22:54:28 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 35FF071426D for ; Thu, 17 Jan 2008 14:54:34 -0800 (PST) Message-ID: <29221409.1200610474218.JavaMail.jira@brutus> Date: Thu, 17 Jan 2008 14:54:34 -0800 (PST) From: "stack (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-2364) when hbase regionserver restarts, it says "impossible state for createLease()" In-Reply-To: <14121628.1196907403247.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560135#action_12560135 ] stack commented on HADOOP-2364: ------------------------------- Happened this morning on a pset machine (About 2 weeks behind TRUNK). Here is excerpt from shutdown followed closely by restart: {code} ... 2008-01-16 03:17:06,124 INFO org.apache.hadoop.hbase.HRegionServer: worker thread exiting 2008-01-16 03:17:06,124 INFO org.apache.hadoop.hbase.HRegionServer: Shutdown thread complete 2008-01-16 03:17:09,755 DEBUG org.apache.hadoop.hbase.HRegionServer: Telling master we are up 2008-01-16 03:17:09,790 WARN org.apache.hadoop.hbase.HRegionServer: error telling master we are up org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.AssertionError: Impossible state for createLease(): Lease -1387125223/-1387125223 is still held. at org.apache.hadoop.hbase.Leases.createLease(Leases.java:145) at org.apache.hadoop.hbase.HMaster.regionServerStartup(HMaster.java:1302) at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:379) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596) at org.apache.hadoop.ipc.Client.call(Client.java:482) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:184) at $Proxy0.regionServerStartup(Unknown Source) at org.apache.hadoop.hbase.HRegionServer.reportForDuty(HRegionServer.java:1073) at org.apache.hadoop.hbase.HRegionServer.run(HRegionServer.java:688) at java.lang.Thread.run(Unknown Source) ... {code} Goes on and on... will try and get master side of things.... > when hbase regionserver restarts, it says "impossible state for createLease()" > ------------------------------------------------------------------------------ > > Key: HADOOP-2364 > URL: https://issues.apache.org/jira/browse/HADOOP-2364 > Project: Hadoop > Issue Type: Bug > Components: contrib/hbase > Affects Versions: 0.16.0 > Reporter: Michael Bieniosek > Priority: Minor > > I restarted a regionserver, and got this error in its logs: > org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.AssertionError: Impossible state for createLease(): Lease -435227488/-435227488 is still held. > at org.apache.hadoop.hbase.Leases.createLease(Leases.java:145) > at org.apache.hadoop.hbase.HMaster.regionServerStartup(HMaster.java:1278 > ) > at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) > at java.lang.reflect.Method.invoke(Unknown Source) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:379) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596) > at org.apache.hadoop.ipc.Client.call(Client.java:482) > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:184) > at $Proxy0.regionServerStartup(Unknown Source) > at org.apache.hadoop.hbase.HRegionServer.reportForDuty(HRegionServer.jav > a:1025) > at org.apache.hadoop.hbase.HRegionServer.run(HRegionServer.java:659) > at java.lang.Thread.run(Unknown Source) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.