Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 46C091849D for ; Thu, 3 Dec 2015 18:15:13 +0000 (UTC) Received: (qmail 65977 invoked by uid 500); 3 Dec 2015 18:15:12 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 65866 invoked by uid 500); 3 Dec 2015 18:15:12 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 65576 invoked by uid 99); 3 Dec 2015 18:15:11 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Dec 2015 18:15:11 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 474532C1F78 for ; Thu, 3 Dec 2015 18:15:11 +0000 (UTC) Date: Thu, 3 Dec 2015 18:15:11 +0000 (UTC) From: "Russ Hatch (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CASSANDRA-10812) CompactionInterruptedException related to seconary index build during rolling upgrade MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-10812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russ Hatch updated CASSANDRA-10812: ----------------------------------- Attachment: node3.log node2_debug.log node2.log node1_debug.log node1.log attaching logs from all nodes. node1_debug.log has the exception. > CompactionInterruptedException related to seconary index build during rolling upgrade > ------------------------------------------------------------------------------------- > > Key: CASSANDRA-10812 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10812 > Project: Cassandra > Issue Type: Bug > Components: Compaction > Reporter: Russ Hatch > Attachments: node1.log, node1_debug.log, node2.log, node2_debug.log, node3.log > > > I'm not certain if this is a problem or not, but during upgrade tests we're observing the following exception: > {noformat} > INFO [RMI TCP Connection(4)-127.0.0.1] 2015-12-02 09:07:11,067 Keyspace.java:600 - adding secondary index table cf.vals to operation > DEBUG [CompactionExecutor:2] 2015-12-02 09:07:11,071 CompactionTask.java:146 - Compacting (be950fe0-990e-11e5-9474-ff4e6f1f6740) [/tmp/dtest-yLzF8G/test/node1/data/upgrade/cf-6a7d8130990e11e5ac03ff4e6f1f6740/upgrade-cf-ka-1-Data.db:level=0, > ] > INFO [CompactionExecutor:1] 2015-12-02 09:07:11,083 CompactionManager.java:1436 - Compaction interrupted: Secondary index build@6a7d8130-990e-11e5-ac03-ff4e6f1f6740(upgrade, cf, 221970/1166280)bytes > ERROR [SecondaryIndexManagement:1] 2015-12-02 09:07:11,096 CassandraDaemon.java:195 - Exception in thread Thread[SecondaryIndexManagement:1,5,main] > java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.cassandra.db.compaction.CompactionInterruptedException: Compaction interrupted: Secondary index build@6a7d8130-990e-11e5-ac03-ff4e6f1f6740(upgrade, cf, 221970/1 > 166280)bytes > at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:368) ~[main/:na] > at org.apache.cassandra.index.internal.CassandraIndex.buildBlocking(CassandraIndex.java:671) ~[main/:na] > at org.apache.cassandra.index.internal.CassandraIndex.lambda$getBuildIndexTask$214(CassandraIndex.java:641) ~[main/:na] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_66] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_66] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_66] > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66] > Caused by: java.util.concurrent.ExecutionException: org.apache.cassandra.db.compaction.CompactionInterruptedException: Compaction interrupted: Secondary index build@6a7d8130-990e-11e5-ac03-ff4e6f1f6740(upgrade, cf, 221970/1166280)bytes > at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.8.0_66] > at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[na:1.8.0_66] > at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:364) ~[main/:na] > ... 6 common frames omitted > Caused by: org.apache.cassandra.db.compaction.CompactionInterruptedException: Compaction interrupted: Secondary index build@6a7d8130-990e-11e5-ac03-ff4e6f1f6740(upgrade, cf, 221970/1166280)bytes > at org.apache.cassandra.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:67) ~[main/:na] > at org.apache.cassandra.db.compaction.CompactionManager$11.run(CompactionManager.java:1269) ~[main/:na] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_66] > ... 4 common frames omitted > {noformat} > These tests are typically writing and reading data continuously and restarting nodes (so perhaps this is a routine exception under those circumstances?). -- This message was sent by Atlassian JIRA (v6.3.4#6332)