incubator-crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitriy Lyubimov <>
Subject Re: Flume R -- any interest?
Date Wed, 17 Oct 2012 21:57:32 GMT
Ok maybe there's a benefit to try a JRI/RJava prototype on top of
Crunch for something simple. This should both save time and prove or
disprove if Crunch via RJava integration is viable.

On my part i can try to do it within Crunch framework or we can keep
it completely separate.


On Wed, Oct 17, 2012 at 2:08 PM, Josh Wills <> wrote:
> I am an avid R user and would be into it-- who gave the talk? Was it
> Murray Stokely?
> On Wed, Oct 17, 2012 at 2:05 PM, Dmitriy Lyubimov <> wrote:
>> Hello,
>> I was pretty excited to learn of Google's experience of R mapping of
>> flume java on one of recent BARUGs. I think a lot of applications
>> similar to what we do in Mahout could be prototyped using flume R.
>> I did not quite get the details of Google implementation of R mapping,
>> but i am not sure if just a direct mapping from R to Crunch would be
>> sufficient (and, for most part, efficient). RJava/JRI and jni seem to
>> be a pretty terrible performer to do that directly.
>> on top of it, I am thinknig if this project could have a contributed
>> adapter to Mahout's distributed matrices, that would be just a very
>> good synergy.
>> Is there anyone interested in contributing/advising for open source
>> version of flume R support? Just gauging interest, Crunch list seems
>> like a natural place to poke.
>> Thanks .
>> -Dmitriy
> --
> Director of Data Science
> Cloudera
> Twitter: @josh_wills

View raw message