mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy Lyubimov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1464) RowSimilarityJob on Spark
Date Tue, 18 Mar 2014 16:32:49 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939451#comment-13939451
] 

Dmitriy Lyubimov commented on MAHOUT-1464:
------------------------------------------

That's what i normally do, yes. The scalabindings issue points to a branch in github. Then
there's commit-squash method (described in my blog) i do when pushing to svn. Hopefully we'd
see direct git pushes for mahout sooner rather than later.
However, seeing a combined ("squashed") patch is pretty useful too as apposed to tons of indivdiual
commits.

> RowSimilarityJob on Spark
> -------------------------
>
>                 Key: MAHOUT-1464
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1464
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Collaborative Filtering
>    Affects Versions: 0.9
>         Environment: hadoop, spark
>            Reporter: Pat Ferrel
>              Labels: performance
>             Fix For: 0.9
>
>         Attachments: MAHOUT-1464.patch, MAHOUT-1464.patch
>
>
> Create a version of RowSimilarityJob that runs on Spark. Ssc has a prototype here: https://gist.github.com/sscdotopen/8314254.
This should be compatible with Mahout Spark DRM DSL so a DRM can be used as input. 
> Ideally this would extend to cover MAHOUT-1422 which is a feature request for RSJ on
two inputs to calculate the similarity of rows of one DRM with those of another. This cross-similarity
has several applications including cross-action recommendations. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message