Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 136E5708B for ; Mon, 24 Oct 2011 16:37:53 +0000 (UTC) Received: (qmail 59455 invoked by uid 500); 24 Oct 2011 16:37:50 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59431 invoked by uid 500); 24 Oct 2011 16:37:50 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59423 invoked by uid 99); 24 Oct 2011 16:37:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Oct 2011 16:37:50 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sylvain@datastax.com designates 209.85.213.44 as permitted sender) Received: from [209.85.213.44] (HELO mail-yw0-f44.google.com) (209.85.213.44) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Oct 2011 16:37:44 +0000 Received: by ywt2 with SMTP id 2so2958420ywt.31 for ; Mon, 24 Oct 2011 09:37:23 -0700 (PDT) Received: by 10.236.109.202 with SMTP id s50mr34902673yhg.96.1319474243065; Mon, 24 Oct 2011 09:37:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.236.154.133 with HTTP; Mon, 24 Oct 2011 09:37:03 -0700 (PDT) X-Originating-IP: [88.183.33.171] In-Reply-To: <7B2D74DD59063D48A2447376C55CE54D45A1A797@MOES1.nisc.lan> References: <7B2D74DD59063D48A2447376C55CE54D45A1A797@MOES1.nisc.lan> From: Sylvain Lebresne Date: Mon, 24 Oct 2011 18:37:03 +0200 Message-ID: Subject: Re: ConcurrentModificationException during nodetool repair To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 On Mon, Oct 24, 2011 at 6:23 PM, Scott Fines wrote: > Hello all, > Right now, I have 10 machines running Cassandra 0.8.7, and mostly they are > working fine. However, during a nodetool repair of one machine, I'm seeing: > ERROR [AntiEntropySessions:12] 2011-10-24 11:17:52,154 > AbstractCassandraDaemon.java (line 139) Fatal exception in thread > Thread[AntiEntropySessions:12,5,RMI Runtime] > java.lang.RuntimeException: java.util.ConcurrentModificationException > at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:619) > Caused by: java.util.ConcurrentModificationException > at java.util.HashMap$HashIterator.nextEntry(HashMap.java:793) > at java.util.HashMap$KeyIterator.next(HashMap.java:828) > at > org.apache.cassandra.service.AntiEntropyService$RepairSession$RepairJob.sendTreeRequests(AntiEntropyService.java:784) > at > org.apache.cassandra.service.AntiEntropyService$RepairSession.runMayThrow(AntiEntropyService.java:680) > at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > ... 6 more > Is this a situation where I need to perform some other maintenance task > before running a repair? No, that sounds like a bug, do you mind opening a ticket on JIRA (https://issues.apache.org/jira/browse/CASSANDRA) This won't have much consequence except that the repair has failed. But you can restart a new one (hoping you won't get the same problem, but hopefully you won't it looks like a race). > Thanks for your help, > Scott Fines