lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler (JIRA)" <j...@apache.org>
Subject [jira] Updated: (LUCENE-1960) Remove deprecated Field.Store.COMPRESS
Date Sat, 24 Oct 2009 17:11:59 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Uwe Schindler updated LUCENE-1960:
----------------------------------

    Attachment: optimize-time.txt

Attached is my comparison of an unoptimzed Lucene 2.9 index optimized with 2.9 and optimized
with 3.0 with the latest patch. The index was about 5.7 GB big and contained 4 compressed
stored fields per document (in addition to ther fields uncompressed) containing XML documents.

After optimization with 3.0, the size doubled (which is because of the very good compression
of XML documents). The optimization took about double time with 3.0, because the fields were
decompressed and no addRawDocuments was used.

To confirm, that everything worked normal after this initial optimization, I updated 38 documents
in both indexes and optimized again. The optimization time of 2.9 was identical, 3.0 took
a little bit longer, which is because the uncompressed field created more copy i/o, which
you see in the "time" output as system time. User time during the initial 2.9 -> 3.0 optimization
was much larger.

The attached document contains all numbers together with the checkindex outputs before and
after each step.

> Remove deprecated Field.Store.COMPRESS
> --------------------------------------
>
>                 Key: LUCENE-1960
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1960
>             Project: Lucene - Java
>          Issue Type: Task
>            Reporter: Michael Busch
>            Assignee: Michael Busch
>            Priority: Minor
>             Fix For: 3.0
>
>         Attachments: lucene-1960-1.patch, lucene-1960-1.patch, lucene-1960.patch, optimize-time.txt
>
>
> Also remove FieldForMerge and related code.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message