Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 66C5E9052 for ; Wed, 21 Sep 2011 03:53:37 +0000 (UTC) Received: (qmail 19024 invoked by uid 500); 21 Sep 2011 03:53:36 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 18845 invoked by uid 500); 21 Sep 2011 03:53:35 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 18377 invoked by uid 99); 21 Sep 2011 03:53:33 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Sep 2011 03:53:33 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Sep 2011 03:53:30 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 104C6A5FBC for ; Wed, 21 Sep 2011 03:53:09 +0000 (UTC) Date: Wed, 21 Sep 2011 03:53:09 +0000 (UTC) From: "Ted Yu (JIRA)" To: issues@hbase.apache.org Message-ID: <2138407868.49330.1316577189063.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <22132091.170001294263285209.JavaMail.jira@thor> Subject: [jira] [Updated] (HBASE-3421) Very wide rows -- 30M plus -- cause us OOME MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-3421: -------------------------- Attachment: 3421.addendum Addendum fixes Store.FIXED_OVERHEAD > Very wide rows -- 30M plus -- cause us OOME > ------------------------------------------- > > Key: HBASE-3421 > URL: https://issues.apache.org/jira/browse/HBASE-3421 > Project: HBase > Issue Type: Bug > Affects Versions: 0.90.0 > Reporter: stack > Assignee: Nate Putnam > Fix For: 0.90.5 > > Attachments: 3421.addendum, HBASE-3421.patch, HBASE-34211-v2.patch, HBASE-34211-v3.patch, HBASE-34211-v4.patch > > > From the list, see 'jvm oom' in http://mail-archives.apache.org/mod_mbox/hbase-user/201101.mbox/browser, it looks like wide rows -- 30M or so -- causes OOME during compaction. We should check it out. Can the scanner used during compactions use the 'limit' when nexting? If so, this should save our OOME'ing (or, we need to add to the next a max size rather than count of KVs). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira