Mailing-List: contact nutch-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: nutch-dev@lucene.apache.org
Message-ID: <46399747.1144067089082.JavaMail.jira@ajax>
Date: Mon, 3 Apr 2006 13:24:49 +0100 (BST)
From: "Andrzej Bialecki  (JIRA)" <jira@apache.org>
To: nutch-dev@incubator.apache.org
Subject: [jira] Closed: (NUTCH-230) OPIC score for outlinks should be based
 on # of valid links, not total # of links.
In-Reply-To: <825076237.1142312701927.JavaMail.jira@ajax>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

     [ http://issues.apache.org/jira/browse/NUTCH-230?page=all ]
     
Andrzej Bialecki  closed NUTCH-230:
-----------------------------------

    Resolution: Fixed

Patch applied.

> OPIC score for outlinks should be based on # of valid links, not total # of links.
> ----------------------------------------------------------------------------------
>
>          Key: NUTCH-230
>          URL: http://issues.apache.org/jira/browse/NUTCH-230
>      Project: Nutch
>         Type: Improvement

>     Versions: 0.8-dev
>     Reporter: Ken Krugler
>     Priority: Minor
>  Attachments: patch.txt
>
> In ParseOutputFormat.java, the write() method currently divides the page score by the # of outlinks:
>           score /= links.length;
> It then loops over the links, and any that pass the normalize/filter gauntlet get added to the crawl output.
> But this means that any filtered links result in some amount of the page's OPIC score being "lost".
> For Nutch 0.7, I built a list of valid (post-filter) links, and then used that to determine the per-link OPIC score, after which I iterated over the list, adding entries to the crawl output.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira