lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (LUCENE-5720) Optimize on disk packed integers part 2
Date Fri, 30 May 2014 21:44:02 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Muir updated LUCENE-5720:
--------------------------------

    Attachment: LUCENE-5720.patch

Here's my first stab. this adds a fastestDirectBits(float overhead) versus trying to integrate
with the existing one, because the logic is different when dealing with the directory API.

We can probably improve this stuff more for 5.0, e.g. the directory api was always geared
at sequential access and we might be able to introduce some API changes later to speed it
up more: but this seems like a safe win.

> Optimize on disk packed integers part 2
> ---------------------------------------
>
>                 Key: LUCENE-5720
>                 URL: https://issues.apache.org/jira/browse/LUCENE-5720
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Robert Muir
>             Fix For: 4.9, 5.0
>
>         Attachments: LUCENE-5720.patch
>
>
> These are heavily optimized for the in-RAM case (for example FieldCache uses PackedInts.FAST
to make it even faster so), but for the docvalues case they are not: we always essentially
use COMPACT, we have only one decoder that must solve all the cases, even the complicated
ones, we use BlockPackedWriter for all integers (even if they are ordinals), etc.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message