lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hoss Man (JIRA)" <>
Subject [jira] [Updated] (SOLR-3981) docBoost is compounded on copyField
Date Wed, 24 Oct 2012 02:00:11 GMT


Hoss Man updated SOLR-3981:

    Attachment: SOLR-3981.patch

bq. i want to work on a test that actually indexes a doc and inspects the encoded norms just
to be certain i'm not missing something.

Updated patch adds this to the test -- kludgy to reach this deep into the lucene code in the
solr test, but do-able.  

Unfortunately the test fails because the decoded norms from the index wind up being way _lower_
then the expected values.  

At first i thought it was just because i forgot to factor in the term length in my expected
norm, but even taking that into account the numbers are still way off.  i'm guessing either
i don't understand something about the new 4.0 APIs for getting the DocValues/Norms, or i've
got some trivially silly bug that i'm blind too because i've been staring at it too long.

I'd appreciate a second set of eyes.
> docBoost is compounded on copyField
> -----------------------------------
>                 Key: SOLR-3981
>                 URL:
>             Project: Solr
>          Issue Type: Bug
>    Affects Versions: 4.0
>            Reporter: Hoss Man
>            Assignee: Hoss Man
>             Fix For: 4.1
>         Attachments: SOLR-3981.patch, SOLR-3981.patch
> As noted by Toke in a comment on SOLR-3875...
> {quote}
> While boosting of multi-value fields is handled correctly in Solr 4.0.0, boosting for
copyFields are not. A sample document:
> {code}
> <add><doc boost="10.0">
>   <field name="id">Insane score Example. Score = 10E9 </field>
>   <field name="name">Document boost broken for copyFields</field>
>   <field name="manu" >video ThomasEgense and Toke Eskildsen</field>
>   <field name="manu_id_s">Test</field>
>   <field name="cat">bug</field>
>   <field name="features">something else</field>
>   <field name="keywords">bug</field>
>   <field name="content">bug</field>
>   </doc></add>
> {code}
> The fields name, manu, cat, features, keywords and content gets copied to text and a
search for thomasegense matches the text-field with query explanation
> {code}
> 70384.67 = (MATCH) weight(text:thomasegense in 0) [DefaultSimilarity], result of:
>   70384.67 = fieldWeight in 0, product of:
>     1.0 = tf(freq=1.0), with freq of:
>       1.0 = termFreq=1.0
>     0.30685282 = idf(docFreq=1, maxDocs=1)
>     229376.0 = fieldNorm(doc=0)
> {code}
> If the two last fields keywords and content are removed from the sample document, the
score is reduced by a factor 100 (docBoost^2).
> {quote}
> (This is a continuation of some of the problems caused by the changes made when the concept
of docBoost was eliminated from the underly IndexWRiter code, and overlooked due to the lack
of testing of docBoosts at the solr level - SOLR-3885))

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message