incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jake Maizel <j...@soundcloud.com>
Subject Disk Full Error on Cleanup
Date Fri, 26 Nov 2010 15:18:21 GMT
Hello,

I keep running into the following error while running a nodetool cleanup:

ERROR [COMPACTION-POOL:1] 2010-11-26 12:36:38,383 CassandraDaemon.java
(line 87) Uncaught exception in thread
Thread[COMPACTION-POOL:1,5,main]
java.lang.UnsupportedOperationException: disk full
        at org.apache.cassandra.db.CompactionManager.doAntiCompaction(CompactionManager.java:344)
        at org.apache.cassandra.db.CompactionManager.doCleanupCompaction(CompactionManager.java:410)
        at org.apache.cassandra.db.CompactionManager.access$400(CompactionManager.java:48)
        at org.apache.cassandra.db.CompactionManager$2.call(CompactionManager.java:129)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)

There is 80GB used out of a 150GB partition that is dedicated to the
cassandra data partition.  So, this seems to related to another issue
around a disk that doesn't have enough space for the anit-compaction.
This keep nodetool cleanup from completing since this occurs at the
beginning of the run.

I also tired running compact on this node and then cleanup but the
same error results.

Any ideas or pointers?

-- 
Jake Maizel
Network Operations
Soundcloud

Mail & GTalk: jake@soundcloud.com
Skype: jakecloud

Rosenthaler strasse 13, 101 19, Berlin, DE

Mime
View raw message