lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrzej Bialecki (Updated) (JIRA)" <>
Subject [jira] [Updated] (LUCENE-3934) Residual IDF calculation in the pruning package is wrong
Date Thu, 29 Mar 2012 20:53:25 GMT


Andrzej Bialecki  updated LUCENE-3934:

    Attachment: LUCENE-3934.patch

Patch that fixes the issue. Added unit test. If no objections I'll commit shortly.
> Residual IDF calculation in the pruning package is wrong
> --------------------------------------------------------
>                 Key: LUCENE-3934
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Bug
>    Affects Versions: 3.5, 3.6
>            Reporter: Andrzej Bialecki 
>            Assignee: Andrzej Bialecki 
>         Attachments: LUCENE-3934.patch
> As discussed on the mailing list ( there
seems to be a bug in both the formula and in the way RIDF is calculated. The formula is missing
a minus, but also the calculation uses local (in-document) term frequency instead of the total
term frequency (sum of all term occurrences in a corpus).

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message