Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4476C6518 for ; Wed, 6 Jul 2011 13:33:50 +0000 (UTC) Received: (qmail 40147 invoked by uid 500); 6 Jul 2011 13:33:48 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 40027 invoked by uid 500); 6 Jul 2011 13:33:47 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 40019 invoked by uid 99); 6 Jul 2011 13:33:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jul 2011 13:33:46 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of izquierdo@strands.com designates 217.116.18.226 as permitted sender) Received: from [217.116.18.226] (HELO mail.strands.com) (217.116.18.226) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jul 2011 13:33:39 +0000 Received: from localhost (localhost [127.0.0.1]) by mail.strands.com (Postfix) with ESMTP id 651B4194ED0 for ; Wed, 6 Jul 2011 15:33:18 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at strands.com X-Spam-Score: -9.5 X-Spam-Level: Received: from mail.strands.com ([127.0.0.1]) by localhost (mail.strands.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bA6FHoXnsnf3 for ; Wed, 6 Jul 2011 15:33:18 +0200 (CEST) Received: from [192.168.1.142] (76.67.217.87.dynamic.jazztel.es [87.217.67.76]) (using SSLv3 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: izquierdo) by mail.strands.com (Postfix) with ESMTPSA id E7D1A706C for ; Wed, 6 Jul 2011 15:33:17 +0200 (CEST) Subject: OutOfMemory during repair on 0.8.1 From: =?ISO-8859-1?Q?H=E9ctor?= Izquierdo Seliva To: user Content-Type: text/plain; charset="UTF-8" Date: Wed, 06 Jul 2011 15:33:16 +0200 Message-ID: <1309959196.11533.14.camel@Avalon> Mime-Version: 1.0 X-Mailer: Evolution 2.32.2 Content-Transfer-Encoding: 7bit X-Old-Spam-Flag: NO X-Old-Spam-Status: No, score=-9.5 required=5.1 tests=[ALL_TRUSTED=-5.5, BAYES_00=-4] autolearn=ham Hi all, I don't seem to be able to complete a full repair on one of the nodes. Memory consuptiom keeps growing till it starts complaining about not having enough heap. I had to disable the automatic memtable flush, as it was generating thousands of almost empty memtables. My guess is that the key indexes that are kept in memory grow with each new sstable that the repair generates. On my third attempt, I have 1102 pending tasks (which seems to be almost all SSTable build operations mixed with a few compactions), and heap is like 80%-85% full Is there a setting or tweak I can make? I had to up the heap from 6GB to 10GB in a 12 GB machine. I can't give it any more heap.