lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bernd Fehling <>
Subject howto run CheckIndex on huge index size
Date Wed, 15 Aug 2012 11:24:39 GMT

I'm trying to run CheckIndex as seperate tool on a large index to get
nice infos about number of terms, number of tokens, ... but always get OOM exception.

Already have JAVA_OPTS -d64 -Xmx25g -Xms25g -Xmn6g

Any idea how to use CheckIndex on huge index size?

Opening index @ /srv/www/solr/solr/solrserver/solr/data/index
Segments file=segments_5u numSegments=1 version=3.6.1 format=FORMAT_3_1 [Lucene 3.1+]
  1 of 1: name=_2rhe docCount=37821132
    size (MB)=182.992,35
    diagnostics = {mergeFactor=1, os.version=, os=Linux, lucene.version=3.6.1-SNAPSHOT
1325634 - solr - 2012-04-13 14:08:0
6, source=merge, os.arch=amd64, mergeMaxNumSegments=1, java.version=1.6.0_29, java.vendor=Sun
Microsystems Inc.}
    no deletions
    test: open reader.........FAILED
    WARNING: fixIndex() would remove reference to this segment; full exception: Map failed
        at org.apache.lucene.index.TermInfosReader.<init>(
        at org.apache.lucene.index.SegmentCoreReaders.<init>(
        at org.apache.lucene.index.SegmentReader.get(
        at org.apache.lucene.index.SegmentReader.get(
        at org.apache.lucene.index.CheckIndex.checkIndex(
        at org.apache.lucene.index.CheckIndex.main(
Caused by: java.lang.OutOfMemoryError: Map failed
        at Method)
        ... 8 more
WARNING: 1 broken segments (containing 37821132 documents) detected
WARNING: would write new segments file, and 37821132 documents would be lost, if -fix were

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message