incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Ellis <jbel...@gmail.com>
Subject Re: Is sstable2json broken in 0.8.4+?
Date Sat, 10 Sep 2011 07:11:00 GMT
Cassandra ensures that data you put into a column matches its
definition, but if you change its definition later it assumes you know
what you're doing and doesn't scan the entire data set to revalidate.

You probably need to switch back to bytestype until you can fix that.

On Fri, Sep 9, 2011 at 6:22 PM, Anthony Ikeda
<anthony.ikeda.dev@gmail.com> wrote:
> Okay, so let me get this straight, the command should accept:
> -f <dest filename> <path to sstable file> (-Data.db)
> The column family in question uses a UTF8Type Row Key and a composite column
> name (UTF8Type, TimeUUID) and UTF8Type Column value.
> Do I need to specify the rowkey, validator and comparator types as well?
> I'm not sure how non utf8 data got into a column for utf8 data.
>     ColumnFamily: ServerIdentityProfiles
>       Key Validation Class: org.apache.cassandra.db.marshal.UTF8Type
>       Default column value validator:
> org.apache.cassandra.db.marshal.UTF8Type
>       Columns sorted by:
> org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.TimeUUIDType)
>       Row cache size / save period in seconds: 1000.0/0
>       Key cache size / save period in seconds: 10000.0/14400
>       Memtable thresholds: 0.29062499999999997/1440/62 (millions of
> ops/minutes/MB)
>       GC grace seconds: 864000
>       Compaction min/max thresholds: 4/32
>       Read repair chance: 1.0
>       Replicate on write: true
>       Built indexes: []
>
>
> On Fri, Sep 9, 2011 at 1:08 PM, Jonathan Ellis <jbellis@gmail.com> wrote:
>>
>> Sounds like you told Cassandra a key? column? was UTF8 but it had
>> non-UTF8 data in it.
>>
>> On Fri, Sep 9, 2011 at 2:06 PM, Anthony Ikeda
>> <anthony.ikeda.dev@gmail.com> wrote:
>> > I can't seem to export an sstable. The parameter flags don't work either
>> > (using -k and -f).
>> >
>> > sstable2json
>> >
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation/ServerIdentityProfiles-g-3-Data.db
>> > WARN 12:01:55,721 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> > {
>> > "6c6f63616c686f7374": [Exception in thread "main"
>> > org.apache.cassandra.db.marshal.MarshalException: invalid UTF8 bytes
>> > 4e694de2
>> > at org.apache.cassandra.db.marshal.UTF8Type.getString(UTF8Type.java:59)
>> > at
>> >
>> > org.apache.cassandra.tools.SSTableExport.serializeColumn(SSTableExport.java:130)
>> > at
>> >
>> > org.apache.cassandra.tools.SSTableExport.serializeColumns(SSTableExport.java:105)
>> > at
>> >
>> > org.apache.cassandra.tools.SSTableExport.serializeRow(SSTableExport.java:191)
>> > at
>> > org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:313)
>> > at
>> > org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:335)
>> > at
>> > org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:348)
>> > at org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:406)
>> >  WARN 12:01:56,321 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,328 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,337 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,343 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,349 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,357 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,367 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,373 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,382 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,386 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,404 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,411 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,419 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,424 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,431 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,435 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,442 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,447 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,453 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>> >  WARN 12:01:56,458 Invalid file '.DS_Store' in data directory
>> > /Users/XXXXX/Database/cassandra_files/data/RegistryFoundation.
>>
>>
>>
>> --
>> Jonathan Ellis
>> Project Chair, Apache Cassandra
>> co-founder of DataStax, the source for professional Cassandra support
>> http://www.datastax.com
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com

Mime
View raw message