Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8CB7B7AC7 for ; Tue, 9 Aug 2011 20:36:50 +0000 (UTC) Received: (qmail 25439 invoked by uid 500); 9 Aug 2011 20:36:50 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 25267 invoked by uid 500); 9 Aug 2011 20:36:49 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 25249 invoked by uid 99); 9 Aug 2011 20:36:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2011 20:36:49 +0000 X-ASF-Spam-Status: No, hits=-2000.8 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2011 20:36:47 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 81281B4EF9 for ; Tue, 9 Aug 2011 20:36:27 +0000 (UTC) Date: Tue, 9 Aug 2011 20:36:27 +0000 (UTC) From: "stack (JIRA)" To: issues@hbase.apache.org Message-ID: <2041544506.21455.1312922187525.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-2077) NullPointerException with an open scanner that expired causing an immediate region server shutdown MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081898#comment-13081898 ] stack commented on HBASE-2077: ------------------------------ Sorry Todd. Will be better going forward. > NullPointerException with an open scanner that expired causing an immediate region server shutdown > -------------------------------------------------------------------------------------------------- > > Key: HBASE-2077 > URL: https://issues.apache.org/jira/browse/HBASE-2077 > Project: HBase > Issue Type: Bug > Components: regionserver > Affects Versions: 0.20.2, 0.20.3 > Environment: Hadoop 0.20.0, Mac OS X, Java 6 > Reporter: Sam Pullara > Assignee: Sam Pullara > Priority: Critical > Fix For: 0.90.4 > > Attachments: 2077-suggestion.txt, 2077-v4.txt, HBASE-2077-3.patch, HBASE-2077-redux.patch, [Bug_HBASE-2077]_Fixes_a_very_rare_race_condition_between_lease_expiration_and_renewal.patch > > Original Estimate: 1h > Remaining Estimate: 1h > > 2009-12-29 18:05:55,432 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner -4250070597157694417 lease expired > 2009-12-29 18:05:55,443 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: > java.lang.NullPointerException > at org.apache.hadoop.hbase.KeyValue$KVComparator.compare(KeyValue.java:1310) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap$KVScannerComparator.compare(KeyValueHeap.java:136) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap$KVScannerComparator.compare(KeyValueHeap.java:127) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap$KVScannerComparator.compare(KeyValueHeap.java:117) > at java.util.PriorityQueue.siftDownUsingComparator(PriorityQueue.java:641) > at java.util.PriorityQueue.siftDown(PriorityQueue.java:612) > at java.util.PriorityQueue.poll(PriorityQueue.java:523) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:113) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:1776) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:1719) > at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1944) > at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:648) > at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915) > 2009-12-29 18:05:55,446 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 55260, call next(-4250070597157694417, 10000) from 192.168.1.90:54011: error: java.io.IOException: java.lang.NullPointerException > java.io.IOException: java.lang.NullPointerException > at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:869) > at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:859) > at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1965) > at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:648) > at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915) > Caused by: java.lang.NullPointerException > at org.apache.hadoop.hbase.KeyValue$KVComparator.compare(KeyValue.java:1310) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap$KVScannerComparator.compare(KeyValueHeap.java:136) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap$KVScannerComparator.compare(KeyValueHeap.java:127) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap$KVScannerComparator.compare(KeyValueHeap.java:117) > at java.util.PriorityQueue.siftDownUsingComparator(PriorityQueue.java:641) > at java.util.PriorityQueue.siftDown(PriorityQueue.java:612) > at java.util.PriorityQueue.poll(PriorityQueue.java:523) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:113) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:1776) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:1719) > at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1944) > ... 5 more > 2009-12-29 18:05:55,447 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server Responder, call next(-4250070597157694417, 10000) from 192.168.1.90:54011: output error > 2009-12-29 18:05:55,448 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 55260 caught: java.nio.channels.ClosedChannelException > at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:126) > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:324) > at org.apache.hadoop.hbase.ipc.HBaseServer.channelWrite(HBaseServer.java:1125) > at org.apache.hadoop.hbase.ipc.HBaseServer$Responder.processResponse(HBaseServer.java:615) > at org.apache.hadoop.hbase.ipc.HBaseServer$Responder.doRespond(HBaseServer.java:679) > at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:943) > 2009-12-29 18:05:56,322 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 55260 > 2009-12-29 18:05:56,322 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server listener on 55260 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira