lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Renaud Delbru (JIRA)" <>
Subject [jira] Updated: (LUCENE-2340) FixedIntBlockIndexOutput encodes unnecessary integers at the end of a list
Date Mon, 22 Mar 2010 18:37:27 GMT


Renaud Delbru updated LUCENE-2340:

    Attachment: LUCENE-1458-FixedIntBlockIndexOutput.patch

Fixed SimpleIntBlockIndex* and added unit test. The new implementation of SimpleIntBlockIndex*
is even more silly than the previous one, and store a vint at the beginning of each block
for recording the length of a block.

> FixedIntBlockIndexOutput encodes unnecessary integers at the end of a list
> --------------------------------------------------------------------------
>                 Key: LUCENE-2340
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: Flex Branch
>            Reporter: Renaud Delbru
>            Priority: Minor
>             Fix For: Flex Branch
>         Attachments: LUCENE-1458-FixedIntBlockIndexOutput.patch, LUCENE-1458-FixedIntBlockIndexOutput.patch
> At closing time, the current FixedIntBlockIndexOutput flushes blocks of blockSize even
if there is only a few integers in the block.
> This can be problematic and causes a big overhead when using large blockSize (e.g., 1024),
on small segments or on rare term posting list. 
> One solution will be to have a secondary flushBlock method with an additional paramter:
the valid length of a buffer. This method will be only called in the FixedIntBlockIndexOutput#close()
> The way this particular block of integers are encoded are left to subclasses.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message