lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-2396) add [ICU]CollationField
Date Tue, 22 Mar 2011 02:30:05 GMT

     [ https://issues.apache.org/jira/browse/SOLR-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Muir updated SOLR-2396:
------------------------------

    Description: 
In LUCENE-2551 collation support was changed to use byte[] keys.

Previously it encoded sort keys with IndexableBinaryString into char[],
but this is wasteful with regards to RAM and disk when terms can be byte.

A better solution would be [ICU]CollationFieldTypes, as this would also allow locale-sensitive
range queries.


  was:
In LUCENE-2551 collation support was changed to use byte[] keys.

Previously it encoded sort keys with IndexableBinaryString into char[],
but this is wasteful with regards to RAM and disk when terms can be byte.

A simple solution is to create tokenizer factories which are KeywordTokenizer + [ICU]CollationAttributeFactory.

A better solution would be [ICU]CollationFieldTypes, as this would allow locale-sensitive
range queries, but I found this to be more difficult due to the fact that the indexed values
are byte[] not String...

        Summary: add [ICU]CollationField  (was: deprecated char[] based collation factories
/ replace with byte[]-based)

editing summary/description to fit

> add [ICU]CollationField
> -----------------------
>
>                 Key: SOLR-2396
>                 URL: https://issues.apache.org/jira/browse/SOLR-2396
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Robert Muir
>             Fix For: 4.0
>
>         Attachments: SOLR-2396.patch, SOLR-2396.patch, SOLR-2396.patch
>
>
> In LUCENE-2551 collation support was changed to use byte[] keys.
> Previously it encoded sort keys with IndexableBinaryString into char[],
> but this is wasteful with regards to RAM and disk when terms can be byte.
> A better solution would be [ICU]CollationFieldTypes, as this would also allow locale-sensitive
range queries.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message