lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Polites (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-648) Allow changing of ZIP compression level for compressed fields
Date Fri, 11 Aug 2006 06:31:14 GMT
    [ http://issues.apache.org/jira/browse/LUCENE-648?page=comments#action_12427449 ] 
            
Jason Polites commented on LUCENE-648:
--------------------------------------

I you find that compression level has a meaningful impact (which it may not as suggested),
one approach for a low-impact fix would be to allow the end user to specify their own Inflater/Deflater
when creating the IndexWriter. If not specified, then behaviour remains as is.  If the user
specifies a different compression level when retrieving the document, that's their bad luck.

> Allow changing of ZIP compression level for compressed fields
> -------------------------------------------------------------
>
>                 Key: LUCENE-648
>                 URL: http://issues.apache.org/jira/browse/LUCENE-648
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.0.0, 1.9, 2.0.1, 2.1
>            Reporter: Michael McCandless
>            Priority: Minor
>
> In response to this thread:
>       http://www.gossamer-threads.com/lists/lucene/java-user/38810
> I think we should allow changing the compression level used in the call to java.util.zip.Deflator
in FieldsWriter.java.  Right now it's hardwired to "best":
>       compressor.setLevel(Deflater.BEST_COMPRESSION);
> Unfortunately, this can apparently cause the zip library to take a very long time (10
minutes for 4.5 MB in the above thread) and so people may want to change this setting.
> One approach would be to read the default from a Java system property, but, it seems
recently (pre 2.0 I think) there was an effort to not rely on Java System properties (many
were removed).
> A second approach would be to add static methods (and static class attr) to globally
set the compression level?
> A third method would be in document.Field class, eg a setCompressLevel/getCompressLevel?
 But then every time a document is created with this field you'd have to call setCompressLevel
since Lucene doesn't have a global Field schema (like Solr).
> Any other ideas / prefererences for either of these methods?

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message