mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suneel Marthi <suneel_mar...@yahoo.com>
Subject Re: Logistic Regression cost function
Date Mon, 13 Jan 2014 21:40:28 GMT
Komarek paper is not what the implementation is based off of. I once was chided by Ted on the
LinkedIn Mahout forums for quoting the Komarek paper (more than 2 years ago).

Here's the link to leon bottou's paper - http://leon.bottou.org/publications/pdf/compstat-2010.pdf








On Monday, January 13, 2014 4:27 PM, Tim Smith <timsmith_s@hotmail.com> wrote:
 
There is a link on http://mahout.apache.org/users/classification/logistic-regression.html
to the following paper:  http://www.autonlab.org/autonweb/14709/version/4/part/5/data/komarek:lr_thesis.pdf?branch=main&language=en



> Date: Mon, 13 Jan 2014 20:58:28 +0100
> Subject: Re: Logistic Regression cost function
> From: frank@frankscholten.nl
> To: user@mahout.apache.org
> 
> Do you know which paper it is? He has quite a few publications. I don't see
> any mention of one of his papers in the code. I only see
> www.eecs.tufts.edu/~dsculley/papers/combined-ranking-and-regression.pdf in
> MixedGradient but this is something different.
> 
> 
> 
> On Mon, Jan 13, 2014 at 1:27 PM, Suneel Marthi <suneel_marthi@yahoo.com>wrote:
> 
> > Mahout's impl is based off of Leon Bottou's paper on this subject.  I
> > don't gave the link handy but it's referenced in the code or try google
> > search
> >
> > Sent from my iPhone
> >
> > > On Jan 13, 2014, at 7:14 AM, Frank Scholten <frank@frankscholten.nl>
> > wrote:
> > >
> > > Hi,
> > >
> > > I followed the Coursera Machine Learning course quite a while ago and I
> > am
> > > trying to find out how Mahout implements the Logistic Regression cost
> > > function in the code surrounding AbstractOnlineLogisticRegression.
> > >
> > > I am looking at the train method in AbstractOnlineLogisticRegression and
> > I
> > > see online gradient descent step where the beta matrix is updated but to
> > me
> > > its unclear how matches with the cost function described at:
> > > http://www.holehouse.org/mlclass/06_Logistic_Regression.html
> > >
> > > Perhaps Mahout uses an optimized approach for that does not directly map
> > > into the formula at that link?
> > >
> > > Cheers,
> > >
> > > Frank
> >
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message