Mailing-List: contact cassandra-commits-help@incubator.apache.org;
 run by ezmlm
Precedence: bulk
Reply-To: cassandra-dev@incubator.apache.org
Message-ID: <1377820341.1260102978083.JavaMail.jira@brutus>
Date: Sun, 6 Dec 2009 12:36:18 +0000 (UTC)
From: "Hudson (JIRA)" <jira@apache.org>
To: cassandra-commits@incubator.apache.org
Subject: [jira] Commented: (CASSANDRA-606) Compaction can't find files
In-Reply-To: <1017235533.1260056120679.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CASSANDRA-606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786611#action_12786611 ] 

Hudson commented on CASSANDRA-606:
----------------------------------

Integrated in Cassandra #279 (See [http://hudson.zones.apache.org/hudson/job/Cassandra/279/])
    ColumnFamily.onStart() was not checking files related to only it's column family. It was possible to remove files from other CFs thinking they were orphans. Skip files not apart of the CF. patch by goffinet; reviewed by jbellis for 


> Compaction can't find files
> ---------------------------
>
>                 Key: CASSANDRA-606
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-606
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.5
>            Reporter: Chris Goffinet
>            Assignee: Chris Goffinet
>             Fix For: 0.5
>
>         Attachments: 0001-ColumnFamily.onStart-was-not-checking-files-related-.patch, 0001-v2-ColumnFamily.onStart-was-not-checking-files-related-.patch
>
>
> We have been seeing issues with compaction running very often. We ran into this case when I found out in one of our CFs we were inserting a high volume of columns. Our threshold for memtable size flushes is 64MB but the MemtableObjectCountInMillions is 0.1 (we know this is low and will increase). On average we are writing so much data that compaction kicks off reguarly. And when we start trying to lookup data, we get lots of errors during compaction and get_slice (since sometimes files don't get cleaned up). In every event that this has occurred, a -Filter file was left behind. Never Data or Index.
> ERROR [COMPACTION-POOL:1] 2009-12-05 15:04:47,412 DebuggableThreadPoolExecutor.java (line 120) Error in executor futuretask
> java.util.concurrent.ExecutionException: java.io.FileNotFoundException: /mnt/var/cassandra/data/Digg/UserActivity-1243-Data.db (No such file or directory)
>         at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
>         at java.util.concurrent.FutureTask.get(FutureTask.java:83)
>         at org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor.afterExecute(DebuggableThreadPoolExecutor.java:112)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:888)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:619)
> Caused by: java.io.FileNotFoundException: /mnt/var/cassandra/data/Digg/UserActivity-1243-Data.db (No such file or directory)
>         at java.io.RandomAccessFile.open(Native Method)
>         at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
>         at java.io.RandomAccessFile.<init>(RandomAccessFile.java:98)
>         at org.apache.cassandra.io.BufferedRandomAccessFile.<init>(BufferedRandomAccessFile.java:142)
>         at org.apache.cassandra.io.SSTableScanner.<init>(SSTableScanner.java:47)
>         at org.apache.cassandra.io.SSTableReader.getScanner(SSTableReader.java:386)
>         at org.apache.cassandra.io.CompactionIterator.getCollatingIterator(CompactionIterator.java:65)
>         at org.apache.cassandra.io.CompactionIterator.<init>(CompactionIterator.java:48)
>         at org.apache.cassandra.db.ColumnFamilyStore.doFileCompaction(ColumnFamilyStore.java:902)
>         at org.apache.cassandra.db.ColumnFamilyStore.doFileCompaction(ColumnFamilyStore.java:861)
>         at org.apache.cassandra.db.ColumnFamilyStore.doCompaction(ColumnFamilyStore.java:663)
>         at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:180)
>         at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:177)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         ... 2 more
>  INFO [main] 2009-12-05 15:08:54,384 SSTable.java (line 156) Deleted /mnt/var/cassandra/data/Digg/UserActivity-1130-Data.db

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.