mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: NMF for Taste
Date Fri, 27 Nov 2009 22:56:40 GMT
NMF, singular value decomposition, random indexing and LDA are all very
interesting and useful methods for recommenders.  If you have lots of data,
then sparsification becomes more important than smoothing and so other
considerations come to the fore.

We have LDA available, but not integrated.  We also have sparsification
using log likelihood ratio tests integrated into Taste.  Jake has been going
gang-busters on decomposition techniques, but mostly SVD so far.  His work
will probably result in random indexing being supported as well.  I don't
know if SVD and random indexing will happen right away in Taste, but it
shouldn't be too long a walk.

NMF has not had much support so far although it is potentially intriguing.
Depending on your constraints and optimization goal, NMF can be equivalent
to pLSI (in which case LDA should be better) or k-means (in which case we
already have it).

Regarding Koren et al's article, you have to take what they say with just a
bit of a grain of salt.  Factorization techniques are definitely very good
if what you want is smallest RMS error on a moderate sized data set that you
can tune nearly forever.  If you want the best click rate or visit length in
a system that has lots of content churn and where you need to account for
the virtuous or vicious cycle that the recommender has on what people watch
then other answers may be better.  This is particularly true when you are
severely constrained on developer time/skill/attention span.

On Fri, Nov 27, 2009 at 11:03 AM, Otis Gospodnetic <
otis_gospodnetic@yahoo.com> wrote:

> Hello,
>
> Recently, I read "Matrix Factorization Techniques for Recommender Systems"
> from http://research.yahoo.com/node/2859 .  I was wondering what you think
> about this vs. what we have in Taste now?
>
> It looks like Collective Intelligence talks about this on p232-239 + 302...
> but I haven't read that yet.
>
> Thanks,
> Otis
>



-- 
Ted Dunning, CTO
DeepDyve

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message