From user-return-37513-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Tue Nov 12 04:07:26 2013 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D0C27106FB for ; Tue, 12 Nov 2013 04:07:26 +0000 (UTC) Received: (qmail 29360 invoked by uid 500); 12 Nov 2013 04:07:23 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 29345 invoked by uid 500); 12 Nov 2013 04:07:23 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 29337 invoked by uid 99); 12 Nov 2013 04:07:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Nov 2013 04:07:22 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [209.85.160.41] (HELO mail-pb0-f41.google.com) (209.85.160.41) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Nov 2013 04:07:17 +0000 Received: by mail-pb0-f41.google.com with SMTP id wy17so6304605pbc.28 for ; Mon, 11 Nov 2013 20:06:57 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:content-type:message-id:mime-version :subject:date:references:to:in-reply-to; bh=eSt7rgJAZVTbGjqhcS+4afVTa0l8ToC4Hl+ZQrMGBN8=; b=Jl3MCQYSXfnIMKMinEnVG4ASZrwIdFeGrqPpjuQe4ghaXBgwSZeb8vhYGj/tIKG3Nd w/W0uuQOKGj7JrcSaKp9kKQ1jhSImbsFuNi+VLIkPlR/VoqcFEBWcV/Sq5nysSOA4hUl ez6lhJwzZuTq34bAeFyrnTbHXe65YJfevqjBOCuN294SxdVzpPP+5VBlc9I200yhLXU5 lIvgACJSuHkzTDGazH8wbza9K0QSauOwAaFJd7rV5HLNaZXoEEA6OcZzFijCvplCh+yR voKU986m3AEia+TivmzVvXYr+UNwBt+nFr0NgDiOG28IljGihudzfJenxIJWxaT++dg/ COBw== X-Gm-Message-State: ALoCoQkoZkiOIMxvgK0QB2p4HC+msCGDsspvFMB7hpHZrK4Sz6j9GNrZUmQHqB+9T8en17bgBR4J X-Received: by 10.68.178.197 with SMTP id da5mr33770353pbc.28.1384229217510; Mon, 11 Nov 2013 20:06:57 -0800 (PST) Received: from [172.16.1.20] ([203.86.207.101]) by mx.google.com with ESMTPSA id qp10sm40206997pab.13.2013.11.11.20.06.55 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 11 Nov 2013 20:06:56 -0800 (PST) From: Aaron Morton Content-Type: multipart/alternative; boundary="Apple-Mail=_E2FB8BF6-F1EF-4DCE-A6A2-099FAF7692A6" Message-Id: Mime-Version: 1.0 (Mac OS X Mail 7.0 \(1822\)) Subject: Re: Duplicate hard link - Cassandra 1.2.9 Date: Tue, 12 Nov 2013 17:06:53 +1300 References: To: Cassandra User In-Reply-To: X-Mailer: Apple Mail (2.1822) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_E2FB8BF6-F1EF-4DCE-A6A2-099FAF7692A6 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=iso-8859-1 > With the scrub --no-snapshots option I get: >=20 > java.util.concurrent.ExecutionException: java.lang.RuntimeException: = java.io.FileNotFoundException: = /data06/rhq/data/system/schema_keyspaces/system-schema_keyspaces-ic-20-Dat= a.db > (No such file or directory) Can you paste the full error from the system.log (it includes the = thread). Sounds like it could be an issue with scrub / snapshot and JBOD.=20 If you can reproduce it may be time to raise a ticket including the JBOD = setup https://issues.apache.org/jira/browse/CASSANDRA Cheers ----------------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/11/2013, at 2:21 pm, Elias Ross wrote: >=20 >=20 >=20 > On Thu, Nov 7, 2013 at 5:08 PM, Robert Coli = wrote: > On Thu, Nov 7, 2013 at 8:23 AM, Elias Ross = wrote: >=20 > I've been attempting a scrub and see the same issue. Is there some = mapping issue? Are six data directories too much for Cassandra? >=20 > Do both filesystems support hard links? >=20 >=20 > I guess so. This is my mount configuration. (note: /data01 links to = /data1 etc.) >=20 > /dev/sdb1 on /data1 type ext3 (rw) > /dev/sdc1 on /data2 type ext3 (rw) > /dev/sdd1 on /data3 type ext3 (rw) > /dev/sde1 on /data4 type ext3 (rw) > /dev/sdf1 on /data5 type ext3 (rw) > /dev/sdg1 on /data6 type ext3 (rw) >=20 > =20 > How do you have JBOD defined? >=20 > cassandra.yaml: >=20 > partitioner: org.apache.cassandra.dht.Murmur3Partitioner > data_file_directories: > - /data01/rhq/data > - /data02/rhq/data > - /data03/rhq/data > - /data04/rhq/data > - /data05/rhq/data > - /data06/rhq/data >=20 --Apple-Mail=_E2FB8BF6-F1EF-4DCE-A6A2-099FAF7692A6 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=iso-8859-1
With the = scrub --no-snapshots option I = get:

java.util.concurrent.ExecutionException= : java.lang.RuntimeException: java.io.FileNotFoundException: = /data06/rhq/data/system/schema_keyspaces/system-schema_keyspaces-ic-20-Dat= a.db
 (No such file or = directory)

Can you paste the = full error from the system.log (it includes the = thread).

Sounds like it could be an issue with = scrub / snapshot and JBOD. 

If you can = reproduce it may be time to raise a ticket including the JBOD = setup https://issues.ap= ache.org/jira/browse/CASSANDRA

Cheers

http://www.thelastpickle.com

On 8/11/2013, at 2:21 pm, Elias Ross <genman@noderunner.net> = wrote:




On Thu, Nov 7, 2013 at 5:08 PM, Robert Coli <rcoli@eventbrite.com> wrote:
On = Thu, Nov 7, 2013 at 8:23 AM, Elias Ross <genericelias@gmail.com> wrote:

I've been attempting a scrub and see the same issue. Is there some = mapping issue? Are six data directories too much for Cassandra?

Do both = filesystems support hard = links?


<= div>I guess so. This is my mount configuration. (note: /data01 links to = /data1 etc.)

/dev/sdb1 on /data1 type ext3 = (rw)
/dev/sdc1 on /data2 type ext3 (rw)
/dev/sdd1 on = /data3 type ext3 (rw)
/dev/sde1 on /data4 type ext3 = (rw)
/dev/sdf1 on /data5 type ext3 (rw)
/dev/sdg1 on /data6 type ext3 = (rw)

 
How do you have JBOD = defined?

cassandra= .yaml:

partitioner: = org.apache.cassandra.dht.Murmur3Partitioner
data_file_directories:
- /data01/rhq/data
- = /data02/rhq/data
- /data03/rhq/data
- = /data04/rhq/data
- /data05/rhq/data
- = /data06/rhq/data


= --Apple-Mail=_E2FB8BF6-F1EF-4DCE-A6A2-099FAF7692A6--