lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Busch (JIRA)" <j...@apache.org>
Subject [jira] Created: (LUCENE-2025) Ability to turn off the store for an index
Date Tue, 03 Nov 2009 22:46:37 GMT
Ability to turn off the store for an index
------------------------------------------

                 Key: LUCENE-2025
                 URL: https://issues.apache.org/jira/browse/LUCENE-2025
             Project: Lucene - Java
          Issue Type: New Feature
          Components: Index
            Reporter: Michael Busch
            Assignee: Michael Busch
            Priority: Minor
             Fix For: 3.1


It would be really good in combination with parallel indexing if the
Lucene store could be turned off entirely for an index. 

The reason is that part of the store is the FieldIndex (.fdx file),
which contains an 8 bytes pointer for each document in a segment, even
if a document does not contain any stored fields.

With parallel indexing we will want to rewrite certain parallel
indexes to update them, and if such an update affects only a small
number of documents it will be a waste if you have to write the .fdx
file every time.

So in the case where you only want to update a data structure in the
inverted index it makes sense to separate your index into multiple
parallel indexes, where the ones you want to update don't contain any
stored fields.

It'd be also great to not only allow turning off the store but to make
it customizable, similarly to what flexible indexing wants to achieve
regarding the inverted index.

As a start I'd be happy with the ability to simply turn off the store and to
add more flexibility later.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message