incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ran Tavory <ran...@gmail.com>
Subject Re: File write errors but cassandra isn't crashing
Date Thu, 19 Aug 2010 05:55:02 GMT
I opened as an improvement suggestion:
https://issues.apache.org/jira/browse/CASSANDRA-1409

On Mon, Aug 16, 2010 at 8:26 PM, Benjamin Black <b@b3k.us> wrote:

> Useful config option, perhaps?
>
> On Mon, Aug 16, 2010 at 8:51 AM, Jonathan Ellis <jbellis@gmail.com> wrote:
> > That's a tough call -- you can also come up with scenarios where you'd
> > rather have it read-only than completely dead.
> >
> > On Wed, Aug 11, 2010 at 12:38 PM, Ran Tavory <rantav@gmail.com> wrote:
> >> Due to administrative error one of the hosts in the cluster lost
> permission
> >> to write to it's data directory.
> >> So I started seeing errors in the log, however, the server continued
> serving
> >> traffic. It wasn't able to compact and do other write operations but it
> >> didn't crash.
> >> I was wondering wether that's by design and if so, is this a good one...
> I
> >> guess I want to know if really bad things happen to my cluster...
> >> logs look like that...
> >>
> >>  INFO [FLUSH-TIMER] 2010-08-11 07:53:14,683 ColumnFamilyStore.java (line
> >> 357) KvAds has reached its threshold; switching in a fresh Memtable at
> >> CommitLogContext(file='/outbrain/cassandra/commitlog/Commi
> >> tLog-1281505164614.log', position=88521163)
> >>  INFO [FLUSH-TIMER] 2010-08-11 07:53:14,683 ColumnFamilyStore.java (line
> >> 609) Enqueuing flush of Memtable(KvAds)@851225759
> >>  INFO [FLUSH-WRITER-POOL:1] 2010-08-11 07:53:14,684 Memtable.java (line
> 148)
> >> Writing Memtable(KvAds)@851225759
> >> ERROR [FLUSH-WRITER-POOL:1] 2010-08-11 07:53:14,688
> >> DebuggableThreadPoolExecutor.java (line 94) Error in executor futuretask
> >> java.util.concurrent.ExecutionException: java.lang.RuntimeException:
> >> java.io.FileNotFoundException:
> >> /outbrain/cassandra/data/outbrain_kvdb/KvAds-tmp-249-Data.db (Permission
> >> denied)
> >>         at
> >> java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> >>         at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> >>         at
> >>
> org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor.afterExecute(DebuggableThreadPoolExecutor.java:86)
> >>         at
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:888)
> >>         at
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> >>         at java.lang.Thread.run(Thread.java:619)
> >> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> >> /outbrain/cassandra/data/outbrain_kvdb/KvAds-tmp-249-Data.db (Permission
> >> denied)
> >>         at
> >> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
> >>         at
> >> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> >>         at
> >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> >>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> >>         at
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> >> ... more
> >
> >
> >
> > --
> > Jonathan Ellis
> > Project Chair, Apache Cassandra
> > co-founder of Riptano, the source for professional Cassandra support
> > http://riptano.com
> >
>

Mime
View raw message