Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Date: Tue, 3 May 2011 12:09:03 +0000 (UTC)
From: "Shai Erera (JIRA)" <jira@apache.org>
To: dev@lucene.apache.org
Message-ID: 
 <1372956307.18329.1304424543362.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Updated] (LUCENE-1076) Allow MergePolicy to select
 non-contiguous merges
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/LUCENE-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shai Erera updated LUCENE-1076:
-------------------------------

    Attachment: LUCENE-1076-3x.patch

Patch against 3x. This is not ready to commit yet, as many tests fail on exceptions like this:

{noformat}
    [junit] java.lang.IndexOutOfBoundsException
    [junit]     at java.util.AbstractList.subList(AbstractList.java:763)
    [junit]     at java.util.Vector.subList(Vector.java:975)
    [junit]     at org.apache.lucene.index.IndexWriter.commitMerge(IndexWriter.java:3550)
    [junit]     at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4057)
    [junit]     at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3631)
{noformat}

Mike says there was  an earlier commit (handled how deletes are flushed) that is a dependency of that, and that I can continue only he back-ports that.

In the meantime, I've fixed tests that assumed LogMP (for setting compound and mergeFactor) by adding LTC.setUseCompoundFile and LTC.setMergeFactor as utility methods.

Will continue after Mike back-ports the dependencies.

> Allow MergePolicy to select non-contiguous merges
> -------------------------------------------------
>
>                 Key: LUCENE-1076
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1076
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.3
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>            Priority: Minor
>             Fix For: 3.2, 4.0
>
>         Attachments: LUCENE-1076-3x.patch, LUCENE-1076.patch, LUCENE-1076.patch, LUCENE-1076.patch
>
>
> I started work on this but with LUCENE-1044 I won't make much progress
> on it for a while, so I want to checkpoint my current state/patch.
> For backwards compatibility we must leave the default MergePolicy as
> selecting contiguous merges.  This is necessary because some
> applications rely on "temporal monotonicity" of doc IDs, which means
> even though merges can re-number documents, the renumbering will
> always reflect the order in which the documents were added to the
> index.
> Still, for those apps that do not rely on this, we should offer a
> MergePolicy that is free to select the best merges regardless of
> whether they are continuguous.  This requires fixing IndexWriter to
> accept such a merge, and, fixing LogMergePolicy to optionally allow
> it the freedom to do so.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org