From user-return-35719-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Fri Aug 2 19:02:07 2013 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0770F10121 for ; Fri, 2 Aug 2013 19:02:07 +0000 (UTC) Received: (qmail 15869 invoked by uid 500); 2 Aug 2013 19:02:04 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 15704 invoked by uid 500); 2 Aug 2013 19:02:00 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 15696 invoked by uid 99); 2 Aug 2013 19:02:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Aug 2013 19:02:00 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of kwright@nanigans.com designates 216.82.243.209 as permitted sender) Received: from [216.82.243.209] (HELO mail1.bemta8.messagelabs.com) (216.82.243.209) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Aug 2013 19:01:54 +0000 Received: from [216.82.242.115:17089] by server-17.bemta-8.messagelabs.com id F8/61-17748-C020CF15; Fri, 02 Aug 2013 19:01:32 +0000 X-Env-Sender: kwright@nanigans.com X-Msg-Ref: server-9.tower-132.messagelabs.com!1375470068!12157723!20 X-Originating-IP: [216.166.12.72] X-StarScan-Received: X-StarScan-Version: 6.9.11; banners=-,-,- X-VirusChecked: Checked Received: (qmail 5784 invoked from network); 2 Aug 2013 19:01:31 -0000 Received: from out001.collaborationhost.net (HELO out001.collaborationhost.net) (216.166.12.72) by server-9.tower-132.messagelabs.com with RC4-SHA encrypted SMTP; 2 Aug 2013 19:01:31 -0000 Received: from AUSP01VMBX28.collaborationhost.net ([192.168.20.73]) by AUSP01MHUB50.collaborationhost.net ([10.2.10.3]) with mapi; Fri, 2 Aug 2013 14:01:30 -0500 From: Keith Wright To: "user@cassandra.apache.org" Date: Fri, 2 Aug 2013 14:01:26 -0500 Subject: org.apache.cassandra.io.sstable.CorruptSSTableException Thread-Topic: org.apache.cassandra.io.sstable.CorruptSSTableException Thread-Index: Ac6PsrImCqDUsGTlTdGXIYKwX50tbw== Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.3.120616 acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CE217A4613EB4kwrightnaniganscom_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_CE217A4613EB4kwrightnaniganscom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi all, We just added a node to our cluster (1.2.4 Vnodes) and they appear to be= running well exception I see that the new node is not making any progress = compacting one of the CF. The exception below is generated. My assumption= is that the only way to handle this is to stop the node, delete the file i= n question, restart, and run repair. Thoughts? org.apache.cassandra.io.sstable.CorruptSSTableException: java.io.IOExceptio= n: dataSize of 1249463589142530 starting at 5604968 would be larger than fi= le /data/3/cassandra/data/users/global_user/users-global_user-ib-1550-Data.= db length 14017479 at org.apache.cassandra.io.sstable.SSTableIdentityIterator.(S= STableIdentityIterator.java:168) at org.apache.cassandra.io.sstable.SSTableIdentityIterator.(S= STableIdentityIterator.java:83) at org.apache.cassandra.io.sstable.SSTableIdentityIterator.(S= STableIdentityIterator.java:69) at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterat= or.next(SSTableScanner.java:177) at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterat= or.next(SSTableScanner.java:152) at org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScann= er.java:139) at org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScann= er.java:36) at org.apache.cassandra.db.compaction.ParallelCompactionIterable$De= serializer$1.runMayThrow(ParallelCompactionIterable.java:288) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.j= ava:28) at java.lang.Thread.run(Thread.java:722) Caused by: java.io.IOException: dataSize of 1249463589142530 starting at 56= 04968 would be larger than file /data/3/cassandra/data/users/global_user/us= ers-global_user-ib-1550-Data.db length 14017479 at org.apache.cassandra.io.sstable.SSTableIdentityIterator.(S= STableIdentityIterator.java:123) ... 9 more --_000_CE217A4613EB4kwrightnaniganscom_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
Hi all,
<= br>
   We just added a node to our cluster (1.2.4 Vnode= s) and they appear to be running well exception I see that the new node is = not making any progress compacting one of the CF.  The exception below= is generated.  My assumption is that the only way to handle this is t= o stop the node, delete the file in question, restart, and run repair.

Thoughts?

org.apache.cassandr= a.io.sstable.CorruptSSTableException: java.io.IOException: dataSize of 1249= 463589142530 starting at 5604968 would be larger than file /data/3/cassandr= a/data/users/global_user/users-global_user-ib-1550-Data.db length 14017479<= /div>
        at org.apache.cassandra.io.sstable.SS= TableIdentityIterator.<init>(SSTableIdentityIterator.java:168)
<= div>        at org.apache.cassandra.io.sstable.SSTableI= dentityIterator.<init>(SSTableIdentityIterator.java:83)
&nb= sp;       at org.apache.cassandra.io.sstable.SSTableIdentity= Iterator.<init>(SSTableIdentityIterator.java:69)
  &nb= sp;     at org.apache.cassandra.io.sstable.SSTableScanner$KeyScan= ningIterator.next(SSTableScanner.java:177)
      &= nbsp; at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator= .next(SSTableScanner.java:152)
        at org= .apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:139)
        at org.apache.cassandra.io.sstable.SST= ableScanner.next(SSTableScanner.java:36)
      &nb= sp; at org.apache.cassandra.db.compaction.ParallelCompactionIterable$Deseri= alizer$1.runMayThrow(ParallelCompactionIterable.java:288)
  =       at org.apache.cassandra.utils.WrappedRunnable.run(Wrap= pedRunnable.java:28)
        at java.lang.Thr= ead.run(Thread.java:722)
Caused by: java.io.IOException: dataSize= of 1249463589142530 starting at 5604968 would be larger than file /data/3/= cassandra/data/users/global_user/users-global_user-ib-1550-Data.db length 1= 4017479
        at org.apache.cassandra.io.ss= table.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:123= )
        ... 9 more

--_000_CE217A4613EB4kwrightnaniganscom_--