mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: Re:Mahout compatibility with GraphLab
Date Thu, 01 Sep 2011 17:41:09 GMT
MRv2 could be huge for Mahout.

+1 for enabling additional computational models as they become feasible.

On Thu, Sep 1, 2011 at 11:26 AM, Josh Patterson <josh@cloudera.com> wrote:

> Danny,
> (Only tangentially understanding the internals of GraphLab) --- is
> there any interest in having this framework run as a first class
> citizen on hadoop (beside MR) similar to:
>
> MPI on hadoop
> https://issues.apache.org/jira/browse/MAPREDUCE-2911
>
> via the new MRv2 framework? I think that would be a really interesting
> way to get GraphLab to work with Mahout as I see MRv2 as enabling a
> lot more functionality in Mahout as we move forward.
>
> Thoughts?
>
> JP
>
> On Sun, Aug 28, 2011 at 10:44 AM, Danny Bickson <danny.bickson@gmail.com>
> wrote:
> > Yes, it is not using map reduce - we have our own communication
> > infrastructure written in C++.
> > You can learn more by looking at http://graphlab.org
> >
> > 2011/8/28 myn <myn@163.com>
> >
> >> Is that a  non hadoop  mapreduce project?
> >>
> >>
> >> At 2011-08-28 21:32:51,myn <myn@163.com> wrote:
> >>
> >>
> >>
> >> sorry i can`t visit the page
> >>
> >>
> http://bickson.blogspot.com/2011/08/graphlab-and-mahout-compatability.html
> >>
> >> At 2011-08-28 20:13:06,"Danny Bickson" <danny.bickson@gmail.com> wrote:
> >> >Hi Mahouters!
> >> >In the last couple of months we are trying to improve CMU GraphLab's
> large
> >> >scale machine learning (http://graphlab.org) compatibility with
> Mahout.
> >> >As a first step, we changed our open source license to Apache. Now we
> are
> >> >working on writing some of the GraphLab wrapper code in Java,
> >> >thus allowing for better interaction between the projects. Our vision
> is
> >> to
> >> >use Mahout for the inherently parallel tasks for large scale data it is
> >> very
> >> >good at,
> >> >while having GraphLab functionality of more complex interactions of
> data.
> >> >
> >> >I am looking for any Mahout users who have large scale matrices that
> are
> >> >factorized using Mahout SVD, who want to try out GraphLab SVD solver.
> >> >I wrote some code to allow for easy transition between Mahout
> >> >SequetialAccessSparseVector to GraphLab's binary format. If anyone
> wants
> >> to
> >> >try
> >> >it out, instructions are found on:
> >> >
> >>
> http://bickson.blogspot.com/2011/08/graphlab-and-mahout-compatability.html
> >> >Any feedback is welcome!
> >> >
> >> >- Danny Bickson
> >>
> >>
> >>
> >>
> >
>
>
>
> --
> Twitter: @jpatanooga
> Solution Architect @ Cloudera
> hadoop: http://www.cloudera.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message