lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] Commented: (SOLR-2396) deprecated char[] based collation factories / replace with byte[]-based
Date Mon, 28 Feb 2011 21:24:37 GMT

    [ https://issues.apache.org/jira/browse/SOLR-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000520#comment-13000520
] 

Robert Muir commented on SOLR-2396:
-----------------------------------

FYI depending on how LUCENE-2943 is resolved, I'll adjust the patch for the ICU 
case to ensure all the operations are thread-safe... right now its not.

> deprecated char[] based collation factories / replace with byte[]-based
> -----------------------------------------------------------------------
>
>                 Key: SOLR-2396
>                 URL: https://issues.apache.org/jira/browse/SOLR-2396
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Robert Muir
>             Fix For: 4.0
>
>         Attachments: SOLR-2396.patch, SOLR-2396.patch
>
>
> In LUCENE-2551 collation support was changed to use byte[] keys.
> Previously it encoded sort keys with IndexableBinaryString into char[],
> but this is wasteful with regards to RAM and disk when terms can be byte.
> A simple solution is to create tokenizer factories which are KeywordTokenizer + [ICU]CollationAttributeFactory.
> A better solution would be [ICU]CollationFieldTypes, as this would allow locale-sensitive
> range queries, but I found this to be more difficult due to the fact that the indexed
values
> are byte[] not String...

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message