With the scrub --no-snapshots option I get:

java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.FileNotFoundException: /data06/rhq/data/system/schema_keyspaces/system-schema_keyspaces-ic-20-Data.db
 (No such file or directory)

Can you paste the full error from the system.log (it includes the thread).

Sounds like it could be an issue with scrub / snapshot and JBOD. 

If you can reproduce it may be time to raise a ticket including the JBOD setup https://issues.apache.org/jira/browse/CASSANDRA


Aaron Morton
New Zealand

Co-Founder & Principal Consultant
Apache Cassandra Consulting

On 8/11/2013, at 2:21 pm, Elias Ross <genman@noderunner.net> wrote:

On Thu, Nov 7, 2013 at 5:08 PM, Robert Coli <rcoli@eventbrite.com> wrote:
On Thu, Nov 7, 2013 at 8:23 AM, Elias Ross <genericelias@gmail.com> wrote:

I've been attempting a scrub and see the same issue. Is there some mapping issue? Are six data directories too much for Cassandra?

Do both filesystems support hard links?

I guess so. This is my mount configuration. (note: /data01 links to /data1 etc.)

/dev/sdb1 on /data1 type ext3 (rw)
/dev/sdc1 on /data2 type ext3 (rw)
/dev/sdd1 on /data3 type ext3 (rw)
/dev/sde1 on /data4 type ext3 (rw)
/dev/sdf1 on /data5 type ext3 (rw)
/dev/sdg1 on /data6 type ext3 (rw)

How do you have JBOD defined?


partitioner: org.apache.cassandra.dht.Murmur3Partitioner
- /data01/rhq/data
- /data02/rhq/data
- /data03/rhq/data
- /data04/rhq/data
- /data05/rhq/data
- /data06/rhq/data