incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From j...@javajet.com
Subject java.lang.OutOfMemoryError: Map failed
Date Mon, 21 Jun 2010 15:35:24 GMT
I am using Lucandra to write Lucene documents to my cassandra server. I am 
processing a MySQL table of about 700k records, 10k at a time. All goes 
well until I reach about 220k mark. Figure it has something to do with my 
lack of correct memory configuration for JVM, keyspace or Cassandra. 

The Map failed is thrown for many *.db files and Cassandra fails to start 
with java.lang.OutOfMemoryError: unable to create new native thread 
message.

ERROR 11:31:49,137 Corrupt file 
/var/lib/cassandra/data/Lucandra/TermInfo-256-Data.db; skipped
java.io.IOException: Map failed
        at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:819)
        at 
org.apache.cassandra.io.SSTableReader.mmap(SSTableReader.java:208)
        at 
org.apache.cassandra.io.SSTableReader.<init>(SSTableReader.java:154)
        at 
org.apache.cassandra.io.SSTableReader.<init>(SSTableReader.java:218)
        at 
org.apache.cassandra.io.SSTableReader.open(SSTableReader.java:123)
        at 
org.apache.cassandra.io.SSTableReader.open(SSTableReader.java:114)
        at 
org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:178)
        at 
org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:248)
        at org.apache.cassandra.db.Table.<init>(Table.java:338)
        at org.apache.cassandra.db.Table.open(Table.java:199)
        at 
org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:91)
        at 
org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:177)
Caused by: java.lang.OutOfMemoryError: Map failed
        at sun.nio.ch.FileChannelImpl.map0(Native Method)
        at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:816)
        ... 11 more
 INFO 11:31:49,140 Replaying 
/var/lib/cassandra/commitlog/CommitLog-1277133857874.log
ERROR 11:31:49,146 Exception encountered during startup.
java.lang.OutOfMemoryError: unable to create new native thread
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(Thread.java:614)
        at 
java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:943)
        at 
java.util.concurrent.ThreadPoolExecutor.prestartAllCoreThreads(ThreadPoolExecutor.java:1549)
        at 
org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.<init>(JMXEnabledThreadPoolExecutor.java:51)
        at 
org.apache.cassandra.concurrent.JMXConfigurableThreadPoolExecutor.<init>(JMXConfigurableThreadPoolExecutor.java:34)
        at 
org.apache.cassandra.concurrent.StageManager.multiThreadedConfigurableStage(StageManager.java:81)
        at 
org.apache.cassandra.concurrent.StageManager.<clinit>(StageManager.java:53)
        at 
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:259)
        at 
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:173)
        at 
org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:95)
        at 
org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:177)
Exception encountered during startup.


Jeffrey Griffin, Developer
JavaJet Consulting  LLC
 o: 1.717.533.5557
m: 1.717.419.2869
skype: javajet.coder
Mime
View raw message