lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4540) Allow packed ints norms
Date Tue, 06 Nov 2012 12:40:13 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491417#comment-13491417
] 

Simon Willnauer commented on LUCENE-4540:
-----------------------------------------

bq. I don't understand the question Simon: all the ones we provide happen to use Norm.setByte
Just to clarify. Currently if we write packed ints and a similarity calls Source#getArray
you get an UOE. I think we should document that our current impls won't handle this. 
                
> Allow packed ints norms
> -----------------------
>
>                 Key: LUCENE-4540
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4540
>             Project: Lucene - Core
>          Issue Type: Task
>          Components: core/index
>            Reporter: Robert Muir
>         Attachments: LUCENE-4540.patch
>
>
> I was curious what the performance would be, because it might be useful option to use
packedints for norms if you have lots of fields and still want good scoring: 
> Today the smallest norm per-field-per-doc you can use is a single byte, and if you have
_f_ fields with norms enabled and _n_ docs, it uses _f_ * _n_ bytes of space in RAM.
> Especially if you aren't using index-time boosting (or even if you are, but not with
ridiculous values), this could be wasting a ton of RAM.
> But then I noticed there was no clean way to allow you to do this in your Similarity:
its a trivial patch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message