mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lance Norskog (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAHOUT-559) Compare Recommender output by order of recommendations.
Date Tue, 07 Dec 2010 10:02:09 GMT

     [ https://issues.apache.org/jira/browse/MAHOUT-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lance Norskog updated MAHOUT-559:
---------------------------------

    Description: 
The existing RecommenderEvaluator (AverageAbsoluteDifferenceRecommenderEvaluator.java) has
a very limited API. It evaluates a Recommender's performance on a training v.s. test scenario.
It does not allow comparing the outputs of different recommenders against the same data model.
Also, I could not figure out how its comparison criteria.

OrderBasedRecommenderEvaluator compares the output of two recommenders. It only checks the
order of the items in the recommendations, ignoring the returned preference values. 











  was:
OrderBasedRecommenderEvaluator compares the output of two recommenders. It only checks the
order of the recommended items, ignoring the returned preferences.

Purpose: the existing RecommenderEvaluator has a very limited use model. It does not allow
comparing the outputs of different recommenders against the same data model. Also, I could
not figure out how its comparison criteria.

OrderBasedRecommenderEvaluator gets a recommendation of N samples for each user available
from the datamodel, from both recommenders. It finds the common items in the two recommendations,
and performs various statistical tests comparing the order of these common items.  It does
not evaluate the items unique to one recommendation. 










> Compare Recommender output by order of recommendations.
> -------------------------------------------------------
>
>                 Key: MAHOUT-559
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-559
>             Project: Mahout
>          Issue Type: New Feature
>          Components: Collaborative Filtering
>            Reporter: Lance Norskog
>
> The existing RecommenderEvaluator (AverageAbsoluteDifferenceRecommenderEvaluator.java)
has a very limited API. It evaluates a Recommender's performance on a training v.s. test scenario.
It does not allow comparing the outputs of different recommenders against the same data model.
Also, I could not figure out how its comparison criteria.
> OrderBasedRecommenderEvaluator compares the output of two recommenders. It only checks
the order of the items in the recommendations, ignoring the returned preference values. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message