lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wettin (JIRA)" <j...@apache.org>
Subject [jira] Updated: (LUCENE-550) InstantiatedIndex - faster but memory consuming index
Date Sun, 11 Feb 2007 17:22:06 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Karl Wettin updated LUCENE-550:
-------------------------------

    Attachment: trunk.diff.bz2

Introduced a method in instantiated index that appends the entire content to any other index.

{code}
/**
   * Adds the complete content of this instantiated index on to any other index using an index
writer.
   * <p/>
   * This can for instance be used for
   * merging multiple instantiated indices
   * and periodically storing persistent snapshots in an FSDirectory.
   * <p/>
   * Non stored offsets are partially rebuilt. This can be improved quite a bit. See comments
in code.
   * <p/>
   * The analyzer creates one complete token stream of all fields with the same name the first
time it is requested,
   * and after that an empty for each remaining. todo: this is a problem?
   * <p/>
   * It can be buggy if the same token appears as synonym to it self (position increment 0).
not really something to worry about.. or?
   *
   * @param indexWriter represents the index on wich to add all the content of this instantiated
index.
   * @throws IOException when accessing parameter indexWriter
   */
  public void writeToIndex(IndexWriterInterface indexWriter) throws IOException {
{code}

> InstantiatedIndex - faster but memory consuming index
> -----------------------------------------------------
>
>                 Key: LUCENE-550
>                 URL: https://issues.apache.org/jira/browse/LUCENE-550
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Store
>    Affects Versions: 2.0.0
>            Reporter: Karl Wettin
>         Assigned To: Karl Wettin
>         Attachments: lucene-550.jpg, test-reports.zip, trunk.diff.bz2, trunk.diff.bz2,
trunk.diff.bz2, trunk.diff.bz2
>
>
> An non file centrinc all in memory index. Consumes some 2x the memory of a RAMDirectory
(in a term satured index) but is between 3x-60x faster depending on application and how one
counts. Average query is about 8x faster. IndexWriter and IndexModifier have been realized
in InterfaceIndexWriter and InterfaceIndexModifier. 
> InstantiatedIndex is wrapped in a new top layer index facade (class Index) that comes
with factory methods for writers, readers and searchers for unison index handeling. There
are decorators with notification handling that can be used for automatically syncronizing
searchers on updates, et.c. 
> Index also comes with FS/RAMDirectory implementation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message