incubator-crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitriy Lyubimov <dlie...@gmail.com>
Subject Re: Flume R -- any interest?
Date Wed, 17 Oct 2012 21:57:32 GMT
Ok maybe there's a benefit to try a JRI/RJava prototype on top of
Crunch for something simple. This should both save time and prove or
disprove if Crunch via RJava integration is viable.

On my part i can try to do it within Crunch framework or we can keep
it completely separate.

-d

On Wed, Oct 17, 2012 at 2:08 PM, Josh Wills <jwills@cloudera.com> wrote:
> I am an avid R user and would be into it-- who gave the talk? Was it
> Murray Stokely?
>
> On Wed, Oct 17, 2012 at 2:05 PM, Dmitriy Lyubimov <dlieu.7@gmail.com> wrote:
>> Hello,
>>
>> I was pretty excited to learn of Google's experience of R mapping of
>> flume java on one of recent BARUGs. I think a lot of applications
>> similar to what we do in Mahout could be prototyped using flume R.
>>
>> I did not quite get the details of Google implementation of R mapping,
>> but i am not sure if just a direct mapping from R to Crunch would be
>> sufficient (and, for most part, efficient). RJava/JRI and jni seem to
>> be a pretty terrible performer to do that directly.
>>
>>
>> on top of it, I am thinknig if this project could have a contributed
>> adapter to Mahout's distributed matrices, that would be just a very
>> good synergy.
>>
>> Is there anyone interested in contributing/advising for open source
>> version of flume R support? Just gauging interest, Crunch list seems
>> like a natural place to poke.
>>
>> Thanks .
>>
>> -Dmitriy
>
>
>
> --
> Director of Data Science
> Cloudera
> Twitter: @josh_wills

Mime
View raw message