lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <>
Subject [jira] Commented: (LUCENE-2975) MMapDirectory on chunk size boundaries broken
Date Fri, 18 Mar 2011 19:15:29 GMT


Robert Muir commented on LUCENE-2975:

Guys, looks like a JRE bug.

Here are Uwe and my tests so far on windows64:
* 1.5.0_22: passes
* 1.6.0_20: passes
* 1.6.0_21: passes
* 1.6.0_24: fails

But we should think about if this should hold up a release, because its not a bug in our code
and trying to make a workaround (like suggesting we use Integer.MAX_VALUE-8 instead of Integer.MAX_VALUE
as a default) is just spitting in the wind...

I for one won't look at the oracle proprietary code.

+1 to unset blocker, and in the release notes mention that recent sun jvms are buggy.

> MMapDirectory on chunk size boundaries broken
> ---------------------------------------------
>                 Key: LUCENE-2975
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Bug
>    Affects Versions: 3.1
>            Reporter: Uwe Schindler
>            Priority: Blocker
>             Fix For: 3.1
> When testing the 3.1-RC1 made by Yonik on the PANGAEA ( productive system
I figured out that suddenly on a large segment (about 5 GiB) some stored fiels suddenly produce
a strange deflate decompression problem (CompressionTools) although the stored fields are
no longer pre-3.0 compressed. It seems that the header of the stored field is read incorrectly
at the buffer boundary in MultiMMapDir and then FieldsReader just incorrectly detects a deflate-compressed
field (CompressionTools).
> The error occurs reproducible on CheckIndex with MMapDirectory, but not with NIODir or
SimpleDir. The FDT file of that segment is 2.6 GiB, on Solaris the chunk size is Integer.MAX_VALUE,
so we have 2 MultiMMap IndexInputs.
> Robert and me have the index ready as a tar file, we will do tests on our local machines
and hopefully solve the bug, maybe introduced by Robert's recent changes to MMap.

This message is automatically generated by JIRA.
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message