Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 11217 invoked from network); 24 Nov 2009 21:04:03 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 24 Nov 2009 21:04:03 -0000 Received: (qmail 30213 invoked by uid 500); 24 Nov 2009 21:04:03 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 30156 invoked by uid 500); 24 Nov 2009 21:04:03 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 30146 invoked by uid 99); 24 Nov 2009 21:04:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Nov 2009 21:04:02 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Nov 2009 21:04:00 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id B1387234C1E9 for ; Tue, 24 Nov 2009 13:03:39 -0800 (PST) Message-ID: <948813637.1259096619724.JavaMail.jira@brutus> Date: Tue, 24 Nov 2009 21:03:39 +0000 (UTC) From: "stack (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-1988) OutOfMemoryError in RegionServer In-Reply-To: <949676261.1258570239590.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12782162#action_12782162 ] stack commented on HBASE-1988: ------------------------------ Stefan has provided me with a heap dump. About 17 byte arrays are > 146M each consuming 2.4G. Stefan is check into it. > OutOfMemoryError in RegionServer > -------------------------------- > > Key: HBASE-1988 > URL: https://issues.apache.org/jira/browse/HBASE-1988 > Project: Hadoop HBase > Issue Type: Bug > Components: regionserver > Affects Versions: 0.20.2 > Environment: Java 1.6.0_16 64bit on CentOS with 3000M max heap > Reporter: Stefan Will > Attachments: regionserver.log.gz > > > RegionServers tend to die with an OutOfMemoryError under load. I expected this problem to go away with the fix for HBASE-1927 in 0.20.2 RC1, but it's still happening. Also, when this happens the cluster becomes unresponsive, even once the load on the machines has gone back down. Interestingly there are lots and lots of scanner lease expired messages right before the OOM. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.