this is expected behaviour. Either increase RF or do a nodetool decommission on a node to remove it from the ring.

On Tue, Aug 2, 2011 at 3:22 PM, Patrik Modesto <> wrote:
Hi all!

I've a test cluster of 4 nodes running cassandra 0.7.8, with one
keyspace with RF=1, each node owns 25% of the data. As long as all
nodes are alive, there is no problem, but when I shut down just one
node I get UnavailableException in my application. cassandra-cli
returns "null" and hadoop mapreduce task won't start at all.

Loosing one node is not a problem for me, the data are not important,
loosing even half the cluster is not a problem as long as everything
runs just as with a full cluster.

The error from hadoop is like this:
Exception in thread "main" Could not get input splits
       at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSplits(
       at org.apache.hadoop.mapred.JobClient.writeNewSplits(
       at org.apache.hadoop.mapred.JobClient.writeSplits(
       at org.apache.hadoop.mapred.JobClient.access$500(
       at org.apache.hadoop.mapred.JobClient$
       at org.apache.hadoop.mapred.JobClient$
       at Method)
       at org.apache.hadoop.mapred.JobClient.submitJobInternal(
       at org.apache.hadoop.mapreduce.Job.submit(
       at org.apache.hadoop.mapreduce.Job.waitForCompletion(
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(
       at java.lang.reflect.Method.invoke(
       at org.apache.hadoop.util.RunJar.main(
Caused by: java.util.concurrent.ExecutionException: failed connecting to all endpoints
       at java.util.concurrent.FutureTask$Sync.innerGet(
       at java.util.concurrent.FutureTask.get(
       at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSplits(
       ... 20 more
Caused by: failed connecting to all endpoints
       at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSubSplits(
       at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.access$200(
       at org.apache.cassandra.hadoop.ColumnFamilyInputFormat$
       at org.apache.cassandra.hadoop.ColumnFamilyInputFormat$
       at java.util.concurrent.FutureTask$Sync.innerRun(
       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(
       at java.util.concurrent.ThreadPoolExecutor$

Paul Loy