Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Mon, 5 Jan 2015 17:35:35 +0000 (UTC)
From: "Leonid Shalupov (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.12764043.1419870567000.11452.1420479335434@Atlassian.JIRA>
In-Reply-To: <JIRA.12764043.1419870567000@Atlassian.JIRA>
References: <JIRA.12764043.1419870567000@Atlassian.JIRA>
 <JIRA.12764043.1419870567138@arcas>
Subject: [jira] [Commented] (CASSANDRA-8544) Cassandra could not start with
 NPE in ColumnFamilyStore.removeUnfinishedCompactionLeftovers
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CASSANDRA-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264804#comment-14264804 ] 

Leonid Shalupov commented on CASSANDRA-8544:
--------------------------------------------

I've seen it two times locally, one time it was reported by the customer of JetBrains Upsource.

It always with compactions_in_progress files, see exception below:
{quote}
14:16:38.232 [MemtableFlushWriter:4] ERROR o.a.c.service.CassandraDaemon - Exception in thread Thread[MemtableFlushWriter:4,5,main]
org.apache.cassandra.io.FSWriteError: java.nio.file.FileSystemException: C:\Tools\Upsource\data\cassandra\data\system\compactions_in_progress-55080a
b05d9c388690a4acb25fe1f77b\system-compactions_in_progress-tmp-ka-13253-Statistics.db: Der Prozess kann nicht auf die Datei zugreifen, da sie von ein
em anderen Prozess verwendet wird.

        at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:135) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:121) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.io.sstable.SSTable.delete(SSTable.java:113) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.io.sstable.SSTableWriter.abort(SSTableWriter.java:355) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.io.sstable.SSTableWriter.abort(SSTableWriter.java:333) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:381) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.db.Memtable$FlushRunnable.runWith(Memtable.java:312) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48) ~[cassandra-all-2.1.1.jar:2.1.1]
        at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[cassandra-all-2.1.1.jar:2.1.1]
        at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) ~[guava-16.0.jar:na]
        at org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1053) ~[cassandra-all-2.1.1.jar:2.1.1]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_71]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_71]
        at java.lang.Thread.run(Thread.java:745) ~[na:1.7.0_71]
{quote}

This particular exception seems to be fixed by turning off AV and Windows Search, but it's no good to fail on the next start.

> How are you resolving / working around this? Does it work after another attempt to restart?
No workarounds attempted. It doesn't work after another restart.

> Attaching a patch that should print out some more details on the NPE if you can reproduce it consistently.
Unfortunately I can't reproduce it consistently, so no luck here.


> Cassandra could not start with NPE in ColumnFamilyStore.removeUnfinishedCompactionLeftovers
> -------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-8544
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8544
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: Windows
>            Reporter: Leonid Shalupov
>            Assignee: Joshua McKenzie
>              Labels: windows
>             Fix For: 2.1.3
>
>         Attachments: 8544_show_npe.txt
>
>
> It happens sometimes after restarts caused by undeletable files under Windows.
> {quote}
> Caused by: java.lang.NullPointerException
>     at org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:579)
>     at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:232)
>     at org.apache.cassandra.service.CassandraDaemon.init(CassandraDaemon.java:377)
>     at com.jetbrains.cassandra.service.CassandraServiceMain.start(CassandraServiceMain.java:81)
>     ... 6 more
> {quote}


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)