lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harald Kirsch <Harald.Kir...@raytion.com>
Subject Invalid fieldsStream maxPointer (file truncated?): maxPointer=2966205946, length=2966208512
Date Wed, 23 Jul 2014 10:03:25 GMT
Hi,

below is an exception I get from one Solr core. According to 
https://issues.apache.org/jira/browse/LUCENE-5617 the check that leads 
to the exception was introduced recently.

Two things are worth mentioning:

a) contrary to the expectation expressed in the message (file 
truncated?), the actual file length is *greater* than the expected length.

b) the actual length is 2966208512=0xB0CC_C000 which looks like rounded 
up to a page size of 4096 bytes.

The code leading to the exception is 
(http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/core/src/java/org/apache/lucene/codecs/compressing/CompressingStoredFieldsReader.java?view=markup&pathrev=1592731)

if (maxPointer + CodecUtil.footerLength() != fieldsStream.length()) {
   throw new CorruptIndexException("Invalid fieldsStream maxPointer 
(file truncated?): maxPointer=" + maxPointer + ", length=" + 
fieldsStream.length());
}


Without delving further into the code, can anyone comment on the chance 
this is actually a bug? Should the test possibly be '<' instead of '!=' 
because fieldsStream.length() is an OS-backed size that may report the 
fully allocated disk space rounded upwards to 4k pages? (Just guessing?)

The Lucene version is the one shipped with solr 4.8.1.

Here is the exception:

Caused by: org.apache.lucene.index.CorruptIndexException: Invalid 
fieldsStream maxPointer (file truncated?): maxPointer=2966205946, 
length=2966208512
         at 
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:136)
         at 
org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
         at 
org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:129)
         at 
org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:101)
         at 
org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:142)
         at 
org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:236)
         at 
org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:99)
         at 
org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:385)
         at 
org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:112)
         at 
org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:41)
         at org.apache.solr.core.SolrCore$2.call(SolrCore.java:815)
         at org.apache.solr.core.SolrCore$2.call(SolrCore.java:808)
         at 
org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1509)

Cheers,
Harald.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message