lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Renaud Delbru (JIRA)" <>
Subject [jira] Commented: (LUCENE-1410) PFOR implementation
Date Fri, 02 Apr 2010 19:32:27 GMT


Renaud Delbru commented on LUCENE-1410:

The fact that S9 is already doing better than VInt is encouraging. Since (P)FOR can do even
better than S9, when using (P)FOR only for longer sequences, I'd expect a real performance
boost for queries using frequently occurring terms in the index.

So, you're suggesting that maybe in my benchmark, the decoded sequence are not long enough
to see the performance improvements of FOR/PFOR ? 

Also, in my benchmark, VINT means block-based VInt. So, there is the same overhead, i.e.,
decompress the full block even if a partial sequence is needed, than for FOR, PFOR, S9 and
the others. But, even with these settings, as you see, the average query time is smaller when
using VInt than FOR/PFOR. 

Also, I'd recommend to verify query results for each method. S9 as I implemented it is only
tested by its own test cases.

We implemented more unit tests for each codec. Also, in the benchmark, I output the number
of hits for each query per codec, and the number of hits for each codec is the same (but I
haven't checked if they returns all the same document ids).

> PFOR implementation
> -------------------
>                 Key: LUCENE-1410
>                 URL:
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Other
>            Reporter: Paul Elschot
>            Priority: Minor
>         Attachments: autogen.tgz, for-summary.txt, LUCENE-1410-codecs.tar.bz2, LUCENE-1410b.patch,
LUCENE-1410c.patch, LUCENE-1410d.patch, LUCENE-1410e.patch, TermQueryTests.tgz,,,
>   Original Estimate: 21840h
>  Remaining Estimate: 21840h
> Implementation of Patched Frame of Reference.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message