lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1313) Realtime Search
Date Sat, 25 Apr 2009 11:39:30 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12702683#action_12702683
] 

Michael McCandless commented on LUCENE-1313:
--------------------------------------------

One separate optimization we should make with NRT is to not close the doc store (stored fields,
term vector) files when flushing for an NRT reader.

We do close them now, which then makes merging quite a bit more costly.

The trickiness with this optimization is we'd need to be able to somehow share an IndexInput
& IndexOutput; or, perhaps we can open an IndexInput even though an IndexOutput has the
same file open (Windows may prevent this, though I think I've seen that it will in fact allow
it).

Once we do that optimization, then with this RAMDir optimization we should try to have the
doc store files punch straight through to the real directory, ie bypass the RAMDir.  The doc
stores are space consuming, and since with autoCommit=false we can bypass merging them, it
makes no sense to store them in the RAMDir.

We should probably do this optimization as a "phase 2", after this one.

> Realtime Search
> ---------------
>
>                 Key: LUCENE-1313
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1313
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>            Priority: Minor
>             Fix For: 2.9
>
>         Attachments: LUCENE-1313.jar, LUCENE-1313.patch, LUCENE-1313.patch, LUCENE-1313.patch,
LUCENE-1313.patch, lucene-1313.patch, lucene-1313.patch, lucene-1313.patch, lucene-1313.patch
>
>
> Realtime search with transactional semantics.  
> Possible future directions:
>   * Optimistic concurrency
>   * Replication
> Encoding each transaction into a set of bytes by writing to a RAMDirectory enables replication.
 It is difficult to replicate using other methods because while the document may easily be
serialized, the analyzer cannot.
> I think this issue can hold realtime benchmarks which include indexing and searching
concurrently.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message