Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@mahout.apache.org
Received-SPF: pass (nike.apache.org: domain of robin.anil@gmail.com designates
 209.85.220.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAFj5n5EK05rM+yj_rPwQGdL7XF+tppCFQL+e6gmMr5QjuqoQSg@mail.gmail.com>
References: 
 <CAJwFCa1661ZGnFVmUFZSNxDzfkpSE7jUFB7DQoC-zv+A55Vnow@mail.gmail.com>
 <CAB+3LJm1NUSm3tAnS6=9NADrH3_B_Do=pE4w4t7=fe3M59VZbg@mail.gmail.com>
 <CANjBk5XpUO31qOm1-hx-_YTOdT6Pf6yfatqVHjrPxnadDEAsEw@mail.gmail.com>
 <CAFj5n5G8hHv-s9z=pQ_iYR-hf_vbL2h=PAR_b6Wiz=jOw3zm7Q@mail.gmail.com>
 <CAB+3LJmirWhnG_iuD3eKM04Xy_nDv35oVRazF1P-BmNFZ6MLVQ@mail.gmail.com>
 <CAFj5n5EK05rM+yj_rPwQGdL7XF+tppCFQL+e6gmMr5QjuqoQSg@mail.gmail.com>
From: Robin Anil <robin.anil@gmail.com>
Date: Thu, 11 Apr 2013 14:45:41 -0500
Message-ID: 
 <CAB+3LJ=i-w6qnhdMwhZv=194OnOue4r97MCAFyP5xDoFX=4=Ow@mail.gmail.com>
Subject: Re: factorization machines as new project
To: Gokhan Capan <gkhncpn@gmail.com>
Cc: Mahout-Dev <dev@mahout.apache.org>, Ted Dunning <ted.dunning@gmail.com>
Content-Type: multipart/alternative; boundary=089e0160c0ac4c375004da1b09ce

--089e0160c0ac4c375004da1b09ce
Content-Type: text/plain; charset=UTF-8

I would have folded them all as different feature ids in a single vector,
makes things a lot simpler and faster.

Robin Anil | Software Engineer | +1 312 869 2602 | Google Inc.


On Thu, Apr 11, 2013 at 11:19 AM, Gokhan Capan <gkhncpn@gmail.com> wrote:

> Hi Robin,
>
> If you are asking why they are arrays, it is because to save clients from
> concatenating multiple matrices to create the input.
>
> I am quoting from libFM paper<http://www.csie.ntu.edu.tw/~b97053/paper/Factorization%20Machines%20with%20libFM.pdf>:
> "For easier interpretation,
> the features are grouped into indicators for the active user (blue),
> active item (red), other movies rated
> by the same user (orange), the time in months (green), and the last movie
> rated (brown)."
>
> I thought a client would create multiple group of matrices, and he can
> just pass them all to the algorithm.
>
> Then the wModel is w parameters, it is still array of vectors for me to
> keep the indexing consistent, and vModel is the V parameters.
>
> Was that what you were asking?
>
>
> On Thu, Apr 11, 2013 at 6:44 PM, Robin Anil <robin.anil@gmail.com> wrote:
>
>> Comments away. I was a bit confused by the use of Vector[] for w1 and
>> Matrix[] for inputs.
>>
>> Robin Anil | Software Engineer | +1 312 869 2602 | Google Inc.
>>
>>
>> On Thu, Apr 11, 2013 at 10:00 AM, Gokhan Capan <gkhncpn@gmail.com> wrote:
>>
>>> Ted,
>>> Robin,
>>>
>>> Although I did not test on a dataset yet, recently I've been
>>> implementing Factorization Machines with SGD optimization.
>>>
>>> The initial implementation is at
>>> https://github.com/gcapan/mahout/tree/fm
>>>
>>> Would you guys consider to take a look so I can make it better and
>>> running?
>>>
>>>
>>>
>>> On Mon, Apr 1, 2013 at 8:45 PM, Nkechi Nnadi <nkechi.nnadi@gmail.com>wrote:
>>>
>>>> Hello,
>>>>
>>>> I'm long time lurker.  I would be interested in implementing these.  I
>>>> thought I would get my feet wet with contributing to wiki with tutorials
>>>> since I have used Mahout for recommendation and clustering in my
>>>> dissertation.  I have never contributed code before and I would love to
>>>> start now.
>>>>
>>>> -Nkechi
>>>>
>>>>
>>>> On Sun, Mar 31, 2013 at 1:14 PM, Robin Anil <robin.anil@gmail.com>
>>>> wrote:
>>>>
>>>> > FMs work really well for a whole range of things. Having implemented
>>>> them
>>>> > myself, I can extend my services as a reviewer if anyone is willing to
>>>> > start on it.
>>>> >
>>>> > Robin Anil | Software Engineer | +1 312 869 2602 | Google Inc.
>>>> >
>>>> >
>>>> > On Sun, Mar 31, 2013 at 2:18 AM, Ted Dunning <ted.dunning@gmail.com>
>>>> > wrote:
>>>> >
>>>> > > Relative to Dan's recent mention of SOM as possible new project,
>>>> here are
>>>> > > slides from KDD Cup 2012 in which Stephen Rendle describes how he
>>>> did
>>>> > using
>>>> > > a very straightforward implementation of Factorization Machines
>>>> [1,2].
>>>> > >
>>>> > >
>>>> > > FMs are interesting in the context of Mahout because they can be
>>>> used in
>>>> > a
>>>> > > wide variety of settings including recommendation and targeting and
>>>> > because
>>>> > > they have very good performance on a number of tasks.
>>>> > >
>>>> > > I should mention that Robin was the one who first mentioned FMs to
>>>> me.
>>>> > >
>>>> > > The KDD 2012 competition [3] is of interest in any case because it
>>>> > provides
>>>> > > a large amount of realistic data for commercially important
>>>> problems.
>>>> > >
>>>> > > [1]
>>>> > >
>>>> > >
>>>> >
>>>> https://kaggle2.blob.core.windows.net/competitions/kddcup2012/2748/media/RendleSlides.pdf
>>>> > >
>>>> > > [2]
>>>> > >
>>>> > >
>>>> >
>>>> https://kaggle2.blob.core.windows.net/competitions/kddcup2012/2748/media/Rendle.pdf
>>>> > >
>>>> > > [3] http://www.kddcup2012.org/
>>>> > >
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> Gokhan
>>>
>>
>>
>
>
> --
> Gokhan
>

--089e0160c0ac4c375004da1b09ce--