lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] Updated: (LUCENE-2886) Adaptive Frame Of Reference
Date Wed, 02 Feb 2011 14:21:29 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Muir updated LUCENE-2886:
--------------------------------

    Attachment: LUCENE-2886_simple64.patch

I pulled out the simple64 implementation here and adapted it to the bulkpostings branch.

Thanks for uploading this code Renaud, its great and the code is easy to work with. I hope
to get some more of the codecs you wrote into the branch for testing.

I changed a few things that helped in benchmarking:
* the decoder uses relative gets instead of absolute
* we write #longs in the block header instead of #bytes (as its always long aligned, but smaller
numbers)

But mainly, for this one I think we should change it to be a VariableIntBlock codec... right
now it packs 128 integers into as few longs as possible, but this is wasteful for two reasons:
it has to write a per-block byte header, and also wastes bits (e.g. in the case of a block
of 128 1's).

With variableintblock, we could do this differently, e.g. read a fixed number of longs per-block
(say 4 longs), and our block would then be variable between 4 and 240 integers depending upon
data.


> Adaptive Frame Of Reference 
> ----------------------------
>
>                 Key: LUCENE-2886
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2886
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Codecs
>            Reporter: Renaud Delbru
>             Fix For: 4.0
>
>         Attachments: LUCENE-2886_simple64.patch, lucene-afor.tar.gz
>
>
> We could test the implementation of the Adaptive Frame Of Reference [1] on the lucene-4.0
branch.
> I am providing the source code of its implementation. Some work needs to be done, as
this implementation is working on the old lucene-1458 branch. 
> I will attach a tarball containing a running version (with tests) of the AFOR implementation,
as well as the implementations of PFOR and of Simple64 (simple family codec working on 64bits
word) that has been used in the experiments in [1].
> [1] http://www.deri.ie/fileadmin/documents/deri-tr-afor.pdf

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message