cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ian douglas <...@armorgames.com>
Subject migrating from 0.6 to 0.8, "java.io.IOError: ... cannot extend file to required size"
Date Tue, 09 Aug 2011 18:16:34 GMT
Hey all,

Thanks to thobbs_ patience in IRC this morning, I got the last of my 
questions answered about migrating from v0.6 to v0.8. My cassandra.yaml 
is mostly stock out of the box other than IP's, ports (I'm running v0.6 
on my workstation at the same time as v0.8), and our cluster name.

I used the v0.8 conf/schema-sample.txt to create a basic keyspace and 
our column families, all pretty basic, looking like this:

create keyspace armorgames
     with strategy_options=[{replication_factor:2}]
     and placement_strategy = 'org.apache.cassandra.locator.SimpleStrategy';

use armorgames;

create column family GameSave2
      with comparator = BytesType
      and keys_cached = 20000
      and rows_cached = 0
      and row_cache_save_period = 0
      and key_cache_save_period = 14400
      and memtable_flush_after = 60
      and memtable_throughput = 255
      and memtable_operations = 0.29;

create column family UserData
     with column_type = Super
     and comparator = BytesType
     and subcomparator = BytesType
     and rows_cached = 0
     and row_cache_save_period = 0
     and key_cache_save_period = 14400
     and memtable_flush_after = 60
     and memtable_throughput = 255
     and memtable_operations = 0.29;


I started up v0.8, used the CLI tool to get the schema imported 
successfully, shut down v0.8, copied the binary data from my v0.6 
/data/armorgames/ path to my v0.8 data path, and restarted v0.8, and now 
get IO errors. Thanks for any assitance!

Ian


INFO 11:12:44,500 Logging initialized
  INFO 11:12:44,514 Heap size: 6290407424/6291456000
  INFO 11:12:44,515 JNA not found. Native methods will be disabled.
  INFO 11:12:44,528 Loading settings from 
file:/data/apache-cassandra-0.8.1/conf/cassandra.yaml
  INFO 11:12:44,643 DiskAccessMode 'auto' determined to be mmap, 
indexAccessMode is mmap
  INFO 11:12:44,752 Global memtable threshold is enabled at 2000MB
  INFO 11:12:44,753 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:44,758 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:44,758 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:44,759 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:44,760 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:44,761 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:44,840 Opening /data/cassandra8/data/system/Schema-g-13
  INFO 11:12:44,869 Opening /data/cassandra8/data/system/Migrations-g-13
  INFO 11:12:44,873 Opening /data/cassandra8/data/system/LocationInfo-g-2
  INFO 11:12:44,875 Opening /data/cassandra8/data/system/LocationInfo-g-1
  INFO 11:12:44,924 Loading schema version 
8fbed060-c2ae-11e0-0000-242d50cf1fff
  INFO 11:12:45,105 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,111 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,117 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,122 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,128 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,134 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,153 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,155 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,156 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,158 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,159 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,159 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,160 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,161 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,162 Removing compacted SSTable files (see 
http://wiki.apache.org/cassandra/MemtableSSTable)
  INFO 11:12:45,173 Opening /data/cassandra8/data/armorgames/Feeds2-1777
  INFO 11:12:45,989 Opening /data/cassandra8/data/armorgames/Status-764
  INFO 11:12:46,008 Opening /data/cassandra8/data/armorgames/Comments-763
  INFO 11:12:46,030 Opening 
/data/cassandra8/data/armorgames/UserGameshareData-8483
  INFO 11:12:54,068 Opening /data/cassandra8/data/armorgames/GameSave2-4849
ERROR 11:12:54,253 Corrupt sstable 
/data/cassandra8/data/armorgames/GameSave2-4849=[Filter.db, Data.db, 
Index.db]; skipped
java.io.EOFException
     at java.io.RandomAccessFile.readByte(RandomAccessFile.java:642)
     at 
org.apache.cassandra.utils.ByteBufferUtil.readShortLength(ByteBufferUtil.java:358)
     at 
org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:368)
     at 
org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:312)
     at 
org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:194)
     at 
org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:280)
     at 
org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:455)
     at 
org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:436)
     at org.apache.cassandra.db.Table.initCf(Table.java:369)
     at org.apache.cassandra.db.Table.<init>(Table.java:306)
     at org.apache.cassandra.db.Table.open(Table.java:111)
     at 
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:161)
     at 
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:315)
     at 
org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:80)
  INFO 11:12:54,257 Opening /data/cassandra8/data/armorgames/UserData-9055
  INFO 11:12:58,779 Opening /data/cassandra8/data/armorgames/Feeds2-1777
ERROR 11:12:58,791 Exception encountered during startup.
java.io.IOError: java.io.IOException: Channel not open for writing - 
cannot extend file to required size
     at 
org.apache.cassandra.io.util.MmappedSegmentedFile$Builder.createSegments(MmappedSegmentedFile.java:170)
     at 
org.apache.cassandra.io.util.MmappedSegmentedFile$Builder.complete(MmappedSegmentedFile.java:147)
     at 
org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:340)
     at 
org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:194)
     at 
org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:280)
     at 
org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:455)
     at 
org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:436)
     at org.apache.cassandra.db.Table.initCf(Table.java:369)
     at org.apache.cassandra.db.Table.<init>(Table.java:306)
     at org.apache.cassandra.db.Table.open(Table.java:111)
     at 
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:161)
     at 
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:315)
     at 
org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:80)
Caused by: java.io.IOException: Channel not open for writing - cannot 
extend file to required size
     at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:768)
     at 
org.apache.cassandra.io.util.MmappedSegmentedFile$Builder.createSegments(MmappedSegmentedFile.java:162)
     ... 12 more
Exception encountered during startup.
java.io.IOError: java.io.IOException: Channel not open for writing - 
cannot extend file to required size
     at 
org.apache.cassandra.io.util.MmappedSegmentedFile$Builder.createSegments(MmappedSegmentedFile.java:170)
     at 
org.apache.cassandra.io.util.MmappedSegmentedFile$Builder.complete(MmappedSegmentedFile.java:147)
     at 
org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:340)
     at 
org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:194)
     at 
org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:280)
     at 
org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:455)
     at 
org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:436)
     at org.apache.cassandra.db.Table.initCf(Table.java:369)
     at org.apache.cassandra.db.Table.<init>(Table.java:306)
     at org.apache.cassandra.db.Table.open(Table.java:111)
     at 
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:161)
     at 
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:315)
     at 
org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:80)
Caused by: java.io.IOException: Channel not open for writing - cannot 
extend file to required size
     at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:768)
     at 
org.apache.cassandra.io.util.MmappedSegmentedFile$Builder.createSegments(MmappedSegmentedFile.java:162)
     ... 12 more



Mime
View raw message