Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 518237DA7 for ; Tue, 15 Nov 2011 06:59:52 +0000 (UTC) Received: (qmail 69342 invoked by uid 500); 15 Nov 2011 06:59:47 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 69208 invoked by uid 500); 15 Nov 2011 06:59:47 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 69158 invoked by uid 500); 15 Nov 2011 06:59:47 -0000 Delivered-To: apmail-incubator-cassandra-user@incubator.apache.org Received: (qmail 69155 invoked by uid 99); 15 Nov 2011 06:59:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Nov 2011 06:59:46 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.214.47] (HELO mail-bw0-f47.google.com) (209.85.214.47) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Nov 2011 06:59:39 +0000 Received: by bkbzs2 with SMTP id zs2so7020226bkb.6 for ; Mon, 14 Nov 2011 22:59:18 -0800 (PST) Received: by 10.205.135.129 with SMTP id ig1mr3270983bkc.106.1321340358253; Mon, 14 Nov 2011 22:59:18 -0800 (PST) Received: from mvapc ([80.179.102.198]) by mx.google.com with ESMTPS id r7sm16374963faa.3.2011.11.14.22.59.16 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 14 Nov 2011 22:59:17 -0800 (PST) From: "Michael Vaknine" To: Cc: References: <1313977679718-6709930.post@n2.nabble.com> <004601cca1ef$ed2803a0$c7780ae0$@com> <000401cca21a$2aa53020$7fef9060$@com> <002501cca29e$0ff83900$2fe8ab00$@com> <009201cca2d4$dd48e450$97daacf0$@com> <00a601cca2d6$a2af99e0$e80ecda0$@com> In-Reply-To: Subject: RE: Upgrade Cassandra Cluster to 1.0.2 Date: Tue, 15 Nov 2011 08:59:16 +0200 Message-ID: <000601cca364$181bbd70$48533850$@com> MIME-Version: 1.0 Content-Type: text/plain; charset="windows-1255" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: Acyi9lGBAXzCNeMDQ4OhmMP2F0epIAAa7MWg Content-Language: en-us X-Virus-Checked: Checked by ClamAV on apache.org I am running java version: java version "1.6.0_20" OpenJDK Runtime Environment (IcedTea6 1.9.7) = (6b20-1.9.7-0ubuntu1~10.04.1) OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode) I have tried to run with -Xss96k or -Xss256k or -Xss320 but it still = give me the error TheNode has 8GB memory and %GB allocated to JAVA ERROR [MutationStage:104] 2011-11-15 08:55:59,408 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[MutationStage:104,5,main] java.lang.StackOverflowError at org.slf4j.impl.Log4jLoggerAdapter.debug(Log4jLoggerAdapter.java:209) at org.apache.cassandra.db.CollationController.collectTimeOrderedData(Collat= ion Controller.java:74) at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationC= ont roller.java:62) at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamily= Sto re.java:1278) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re. java:1164) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re. java:1126) at org.apache.cassandra.db.Table.readCurrentIndexedColumns(Table.java:507) at org.apache.cassandra.db.Table.apply(Table.java:444) at org.apache.cassandra.db.RowMutation.applyUnsafe(RowMutation.java:260) at org.apache.cassandra.db.CollationController.collectTimeOrderedData(Collat= ion Controller.java:159) at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationC= ont roller.java:62) at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamily= Sto re.java:1278) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re. java:1164) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re. java:1126) at org.apache.cassandra.db.Table.readCurrentIndexedColumns(Table.java:507) at org.apache.cassandra.db.Table.apply(Table.java:444) at org.apache.cassandra.db.RowMutation.applyUnsafe(RowMutation.java:260) at org.apache.cassandra.db.CollationController.collectTimeOrderedData(Collat= ion Controller.java:159) at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationC= ont roller.java:62) at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamily= Sto re.java:1278) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re. java:1164) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re. java:1126) at org.apache.cassandra.db.Table.readCurrentIndexedColumns(Table.java:507) at org.apache.cassandra.db.Table.apply(Table.java:444) I ma getting WARN as well after changing JAVA WARN [MutationStage:44] 2011-11-15 08:51:57,479 Memtable.java (line 142) MemoryMeter uninitialized (jamm not specified as java agent); assuming liveRatio of 10.0. Usually this means cassandra-env.sh disabled jamm because you are using a buggy JRE; upgrade to the Sun JRE instead -----Original Message----- From: Brandon Williams [mailto:driftx@gmail.com]=20 Sent: Monday, November 14, 2011 7:53 PM To: user@cassandra.apache.org Cc: cassandra-user@incubator.apache.org Subject: Re: Upgrade Cassandra Cluster to 1.0.2 On Mon, Nov 14, 2011 at 8:06 AM, Michael Vaknine wrote: > Well, > I tried to delete the hints on the failed cluster but I could not = start it > I got other errors such as > > ERROR [MutationStage:34] 2011-11-14 15:37:43,813 > AbstractCassandraDaemon.java (line 133) Fatal exception in thread > Thread[MutationStage:34,5,main] > java.lang.StackOverflowError > =A0 =A0 =A0 =A0at > java.util.concurrent.atomic.AtomicReferenceFieldUpdater$AtomicReferenceFi= eld > UpdaterImpl.updateCheck(AtomicReferenceFieldUpdater.java:216) This is different an unrelated to hints. What jvm are you using? It looks like it just simply ran out of stack space, which is odd, but you can control that with the -Xss option if needed. -Brandon