lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Rutherglen (JIRA)" <>
Subject [jira] Created: (LUCENE-2312) Search on IndexWriter's RAM Buffer
Date Fri, 12 Mar 2010 23:11:27 GMT
Search on IndexWriter's RAM Buffer

                 Key: LUCENE-2312
             Project: Lucene - Java
          Issue Type: New Feature
          Components: Search
    Affects Versions: 3.0.1
            Reporter: Jason Rutherglen
             Fix For: 3.0.2

In order to offer user's near realtime search, without incurring
an indexing performance penalty, we can implement search on
IndexWriter's RAM buffer. This is the buffer that is filled in
RAM as documents are indexed. Currently the RAM buffer is
flushed to the underlying directory (usually disk) before being
made searchable. 

Todays Lucene based NRT systems must incur the cost of merging
segments, which can slow indexing. 

Michael Busch has good suggestions regarding how to handle deletes using max doc ids.

The area that isn't fully fleshed out is the terms dictionary,
which needs to be sorted prior to queries executing. Currently
IW implements a specialized hash table. Michael B has a
suggestion here:

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message