lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Carlos González-Cadenas (Commented) (JIRA) <>
Subject [jira] [Commented] (LUCENE-3298) FST has hard limit max size of 2.1 GB
Date Mon, 05 Dec 2011 10:57:39 GMT


Carlos González-Cadenas commented on LUCENE-3298:

Hello Dawid,

The sentences have variants at different levels. The first is the one you mention, different
prefixes for different accomodation types. The second one is different positions of the prepositional
phrases of the query (i.e. "hotels in barcelona with jacuzzi" and "hotels with jacuzzi in
barcelona"). The third one we have is sentences with and without prepositions ("hotels barcelona

W.r.t the patch, sorry, I got confused. James, do you have a version of this patch that works
with trunk?

Thanks a lot.
> FST has hard limit max size of 2.1 GB
> -------------------------------------
>                 Key: LUCENE-3298
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: core/FSTs
>            Reporter: Michael McCandless
>            Priority: Minor
>         Attachments: LUCENE-3298.patch
> The FST uses a single contiguous byte[] under the hood, which in java is indexed by int
so we cannot grow this over Integer.MAX_VALUE.  It also internally encodes references to this
array as vInt.
> We could switch this to a paged byte[] and make the far larger.
> But I think this is low priority... I'm not going to work on it any time soon.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message