lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Grant Ingersoll (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-648) Allow changing of ZIP compression level for compressed fields
Date Fri, 11 Aug 2006 01:29:14 GMT
    [ http://issues.apache.org/jira/browse/LUCENE-648?page=comments#action_12427385 ] 
            
Grant Ingersoll commented on LUCENE-648:
----------------------------------------

Just curious, have you tried other values in here to see what kind of difference it makes
before we go looking for a solution?  Could you maybe put together a little benchmark that
tries out the various levels and report back?

It could be possible to add another addDocument method from the IndexWriter, so you could
change it per document, we could make it part of the constructor to IndexWriter or we could
do it as mentioned above.  I am not sure what is the best way just yet.

I think this also may fall under the notion of the Flexible Indexing thread that we have been
talking about (someday it will get implemented).

> Allow changing of ZIP compression level for compressed fields
> -------------------------------------------------------------
>
>                 Key: LUCENE-648
>                 URL: http://issues.apache.org/jira/browse/LUCENE-648
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.0.0, 1.9, 2.0.1, 2.1
>            Reporter: Michael McCandless
>            Priority: Minor
>
> In response to this thread:
>       http://www.gossamer-threads.com/lists/lucene/java-user/38810
> I think we should allow changing the compression level used in the call to java.util.zip.Deflator
in FieldsWriter.java.  Right now it's hardwired to "best":
>       compressor.setLevel(Deflater.BEST_COMPRESSION);
> Unfortunately, this can apparently cause the zip library to take a very long time (10
minutes for 4.5 MB in the above thread) and so people may want to change this setting.
> One approach would be to read the default from a Java system property, but, it seems
recently (pre 2.0 I think) there was an effort to not rely on Java System properties (many
were removed).
> A second approach would be to add static methods (and static class attr) to globally
set the compression level?
> A third method would be in document.Field class, eg a setCompressLevel/getCompressLevel?
 But then every time a document is created with this field you'd have to call setCompressLevel
since Lucene doesn't have a global Field schema (like Solr).
> Any other ideas / prefererences for either of these methods?

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message