cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From JKnight JKnight <beukni...@gmail.com>
Subject Re: Can fix corrupt file? (Compaction step)
Date Tue, 12 Jan 2010 01:36:55 GMT
Dear Mr Jonathan,

Did you get the attachment?

On Sun, Jan 10, 2010 at 8:59 PM, JKnight JKnight <beuknight@gmail.com>wrote:

> The attachment contains data that raise error in compact step.
> Could you help me to detect the problem?
>
>
> On Fri, Jan 8, 2010 at 3:09 PM, Jonathan Ellis <jbellis@gmail.com> wrote:
>
>> Can you gzip the sstable that OOMs and send it to me off-list?
>>
>> On Fri, Jan 8, 2010 at 11:26 AM, JKnight JKnight <beuknight@gmail.com>
>> wrote:
>> > Dear Mr Jonathan,
>> > With the larger sstable, I don't have any problem. So I think that the
>> error
>> > does not related to the heap size. And my data model does not use
>> > SuperColumn, so I think the the number of columns in row is not the
>> > problem.
>> > I have tried to delete error row and accept data lost.
>> >
>> > On Fri, Jan 8, 2010 at 11:08 AM, Jonathan Ellis <jbellis@gmail.com>
>> wrote:
>> >>
>> >> How many columns do you have in your rows?  How big a heap are you
>> >> giving to sstable2json?
>> >>
>> >> On Thu, Jan 7, 2010 at 9:37 PM, JKnight JKnight <beuknight@gmail.com>
>> >> wrote:
>> >> > Yes. The error is ERROR: Out of memory deserializing row 2829049.
>> >> > I've tried to delete this row immediately. But now Cassandra does not
>> >> > support delete immediately. Maybe I have to code it.
>> >> >
>> >> > On Thu, Jan 7, 2010 at 12:28 PM, Jonathan Ellis <jbellis@gmail.com>
>> >> > wrote:
>> >> >>
>> >> >> do you get any errors when running sstable2json on the files being
>> >> >> compacted?
>> >> >>
>> >> >> On Thu, Jan 7, 2010 at 3:49 AM, JKnight JKnight <
>> beuknight@gmail.com>
>> >> >> wrote:
>> >> >> > Dear all,
>> >> >> >
>> >> >> > In compact step, I found the error in file SSTableScanner.java
at
>> the
>> >> >> > following method
>> >> >> >         public IteratingRow next()
>> >> >> >         {
>> >> >> >             try
>> >> >> >             {
>> >> >> >                 if (row != null)
>> >> >> >                     row.skipRemaining();
>> >> >> >                 assert !file.isEOF();
>> >> >> >                 return row = new IteratingRow(file, sstable);
>> >> >> >             }
>> >> >> >             catch (IOException e)
>> >> >> >             {
>> >> >> >                 logger.debug("IteratingRow next Exception
" +
>> >> >> > sstable.getFilename());
>> >> >> >                 throw new RuntimeException(e);
>> >> >> >             }
>> >> >> >         }
>> >> >> > The error is: Caused by: java.lang.RuntimeException:
>> >> >> > java.io.UTFDataFormatException: malformed input around byte
13
>> >> >> >     at
>> >> >> >
>> >> >> >
>> >> >> >
>> org.apache.cassandra.io.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:120)
>> >> >> >
>> >> >> > Can I fix corrupt file?
>> >> >> > And how I can do?
>> >> >> > I have tried almost Cassandra version and the error still
occur.
>> >> >> >
>> >> >> > Thank a lot for support.
>> >> >> >
>> >> >> > --
>> >> >> > Best regards,
>> >> >> > JKnight
>> >> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Best regards,
>> >> > JKnight
>> >> >
>> >
>> >
>> >
>> > --
>> > Best regards,
>> > JKnight
>> >
>>
>
>
>
> --
> Best regards,
> JKnight
>



-- 
Best regards,
JKnight

Mime
View raw message