lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <>
Subject [jira] [Updated] (LUCENE-4515) Make MemoryIndex more memory efficient
Date Wed, 31 Oct 2012 12:07:11 GMT


Simon Willnauer updated LUCENE-4515:

    Attachment: LUCENE-4515.patch

here is a patch that cuts over MemoryIndex to ByteBlockPool (store terms) / IntBlockPool (store
postings) and using BytesRefHash to hold the term dictionary. This patch still has some edges
and some nocommits but in general this is what I had in mind. I factored out IntBlockPool
out of TermsHash / DWPT and made it more general or useable for slice writing reading. I haven't
done any benchmarks yet but I could imagine its even faster than before due to better memory

comments welcome.
> Make MemoryIndex more memory efficient
> --------------------------------------
>                 Key: LUCENE-4515
>                 URL:
>             Project: Lucene - Core
>          Issue Type: Improvement
>          Components: modules/other
>    Affects Versions: 4.0, 4.1, 5.0
>            Reporter: Simon Willnauer
>             Fix For: 4.1, 5.0
>         Attachments: LUCENE-4515.patch
> Currently MemoryIndex uses BytesRef objects to represent terms and holds an int[] per
term per field to represent postings. For highlighting this creates a ton of objects for each
search that 1. need to be GCed and 2. can't be reused.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message