Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EEFE6E5B0 for ; Tue, 5 Feb 2013 16:19:14 +0000 (UTC) Received: (qmail 89791 invoked by uid 500); 5 Feb 2013 16:19:14 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 89634 invoked by uid 500); 5 Feb 2013 16:19:14 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 89610 invoked by uid 99); 5 Feb 2013 16:19:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Feb 2013 16:19:13 +0000 Date: Tue, 5 Feb 2013 16:19:13 +0000 (UTC) From: "Yuki Morishita (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CASSANDRA-5222) OOM Exception during repair session with LeveledCompactionStrategy MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13571419#comment-13571419 ] Yuki Morishita commented on CASSANDRA-5222: ------------------------------------------- This is not only for L0. Currently we are opening SSTBS for all sstable and then filter out those that are out of range. We can change that to only open the sstables for the range we are repairing. This change only still leaves the chance to OOM, so we can prevent repair to perform when the number of sstables for given range is too large. > OOM Exception during repair session with LeveledCompactionStrategy > ------------------------------------------------------------------ > > Key: CASSANDRA-5222 > URL: https://issues.apache.org/jira/browse/CASSANDRA-5222 > Project: Cassandra > Issue Type: Bug > Affects Versions: 1.0.0 > Environment: 3Gb Heap(12Gb per node RAM) > 36 nodes, 0.9 Tb of data per node, Leveled compaction strategy, SSTable size =100Mb > Reporter: Ivan Sobolev > Assignee: Yuki Morishita > Fix For: 1.1.10 > > Attachments: chunks.json, sstablescanner.png > > > 1.8 Gb of heap is consumed with 12k SSTableBoundedScanner * 140kbytes -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira