Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 17D0210BB3 for ; Fri, 30 May 2014 21:44:03 +0000 (UTC) Received: (qmail 11821 invoked by uid 500); 30 May 2014 21:44:02 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 11696 invoked by uid 500); 30 May 2014 21:44:02 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 11628 invoked by uid 99); 30 May 2014 21:44:02 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 May 2014 21:44:02 +0000 Date: Fri, 30 May 2014 21:44:02 +0000 (UTC) From: "Robert Muir (JIRA)" To: dev@lucene.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (LUCENE-5720) Optimize on disk packed integers part 2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/LUCENE-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir updated LUCENE-5720: -------------------------------- Attachment: LUCENE-5720.patch Here's my first stab. this adds a fastestDirectBits(float overhead) versus trying to integrate with the existing one, because the logic is different when dealing with the directory API. We can probably improve this stuff more for 5.0, e.g. the directory api was always geared at sequential access and we might be able to introduce some API changes later to speed it up more: but this seems like a safe win. > Optimize on disk packed integers part 2 > --------------------------------------- > > Key: LUCENE-5720 > URL: https://issues.apache.org/jira/browse/LUCENE-5720 > Project: Lucene - Core > Issue Type: Improvement > Reporter: Robert Muir > Fix For: 4.9, 5.0 > > Attachments: LUCENE-5720.patch > > > These are heavily optimized for the in-RAM case (for example FieldCache uses PackedInts.FAST to make it even faster so), but for the docvalues case they are not: we always essentially use COMPACT, we have only one decoder that must solve all the cases, even the complicated ones, we use BlockPackedWriter for all integers (even if they are ordinals), etc. -- This message was sent by Atlassian JIRA (v6.2#6252) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org