mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Patterson <j...@cloudera.com>
Subject Re: Re:Mahout compatibility with GraphLab
Date Thu, 01 Sep 2011 17:39:55 GMT
>From the Cloudera side, there is also Ahmed Radwan, who I'm sure would
answer questions you may have.

JP

On Thu, Sep 1, 2011 at 1:39 PM, Josh Patterson <josh@cloudera.com> wrote:
> This feature seems to be principly driven by a few folks @ Yahoo. Arun
> Murthy seems to be quite involved.
>
> Hama is also getting into the MRv2 game:
> https://issues.apache.org/jira/browse/HAMA-431
>
> Quick presentation on the framework by Sharad Agarwal (Yahoo):
> https://issues.apache.org/jira/secure/attachment/12485267/hadoop_contributors_meet_07_01_2011.pdf
>
> Seems to be a considerably more native/clean approach than managing a
> bunch of C++ to Java wrappers, imho. I'd really like to see a lot of
> frameworks on Hadoop; could have a language like Pig that then
> compiled down not only to different ML techniques, but also execute
> them on the proper framework in MRv2 as well.
>
> JP
>
> On Thu, Sep 1, 2011 at 1:12 PM, Danny Bickson <danny.bickson@gmail.com> wrote:
>> This is definitely a very interesting option to integrate both projects. I
>> will forward this to my
>> collaborators - specifically, Joey Gonzalez was recently an Intern at Yahoo!
>> and looked at similar directions.
>> I will try to learn the technical details better to see how this
>> interoperability works.
>> Who is working on this project in case we need more details?
>>
>> Thanks,
>>
>> Danny Bickson
>>
>> On Thu, Sep 1, 2011 at 7:26 PM, Josh Patterson <josh@cloudera.com> wrote:
>>
>>> Danny,
>>> (Only tangentially understanding the internals of GraphLab) --- is
>>> there any interest in having this framework run as a first class
>>> citizen on hadoop (beside MR) similar to:
>>>
>>> MPI on hadoop
>>> https://issues.apache.org/jira/browse/MAPREDUCE-2911
>>>
>>> via the new MRv2 framework? I think that would be a really interesting
>>> way to get GraphLab to work with Mahout as I see MRv2 as enabling a
>>> lot more functionality in Mahout as we move forward.
>>>
>>> Thoughts?
>>>
>>> JP
>>>
>>>
>>
>
>
>
> --
> Twitter: @jpatanooga
> Solution Architect @ Cloudera
> hadoop: http://www.cloudera.com
>



-- 
Twitter: @jpatanooga
Solution Architect @ Cloudera
hadoop: http://www.cloudera.com

Mime
View raw message