mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pat Ferrel (JIRA)" <>
Subject [jira] [Commented] (MAHOUT-1045) Cluster evaluators returning bad results
Date Wed, 18 Jul 2012 21:15:34 GMT


Pat Ferrel commented on MAHOUT-1045:

BTW It would be nice have access to the evaluator measures for each cluster so keeping them
in a collection (for example densities) is very helpful. How will I get access to those? I
think you talked about adding them to the output file. I hate to ask for too much but is it
possible to add them to the data in the CE instance?

ce.intraClusterDensities() could return the collection perhaps?

Same for CDbw instance?
> Cluster evaluators returning bad results
> ----------------------------------------
>                 Key: MAHOUT-1045
>                 URL:
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.6, 0.7, 0.8
>         Environment: Several environments and data sets
>            Reporter: Pat Ferrel
>             Fix For: 0.8
>         Attachments: MAHOUT-1045.patch, MAHOUT-1045.patch, first-time-density-nan.txt
> With real world crawl data the Intra-cluster density from ClusterEvaluator is almost
always NaN. The CDbw inter-cluster density is almost always 0. I have also seen several cases
where CDbw fails to return any results but have not tracked down why yet.
> I have sent a link to an 8G data set that reproduces these errors to Jeff Eastman.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message