Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 76BA64B0B for ; Fri, 27 May 2011 14:43:31 +0000 (UTC) Received: (qmail 38039 invoked by uid 500); 27 May 2011 14:43:31 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 37993 invoked by uid 500); 27 May 2011 14:43:30 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 37985 invoked by uid 99); 27 May 2011 14:43:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 May 2011 14:43:30 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 May 2011 14:43:28 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 6AB3EE27C7 for ; Fri, 27 May 2011 14:42:47 +0000 (UTC) Date: Fri, 27 May 2011 14:42:47 +0000 (UTC) From: "stack (JIRA)" To: issues@hbase.apache.org Message-ID: <2015040487.48804.1306507367433.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <22132091.170001294263285209.JavaMail.jira@thor> Subject: [jira] [Commented] (HBASE-3421) Very wide rows -- 30M plus -- cause us OOME MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040260#comment-13040260 ] stack commented on HBASE-3421: ------------------------------ bq. Anyone foresee an issue with just using a limit of 10 KVs on the scan(kvs) call in the compaction loop? No. Things might run imperceptibly slower. > Very wide rows -- 30M plus -- cause us OOME > ------------------------------------------- > > Key: HBASE-3421 > URL: https://issues.apache.org/jira/browse/HBASE-3421 > Project: HBase > Issue Type: Bug > Affects Versions: 0.90.0 > Reporter: stack > > From the list, see 'jvm oom' in http://mail-archives.apache.org/mod_mbox/hbase-user/201101.mbox/browser, it looks like wide rows -- 30M or so -- causes OOME during compaction. We should check it out. Can the scanner used during compactions use the 'limit' when nexting? If so, this should save our OOME'ing (or, we need to add to the next a max size rather than count of KVs). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira