Mailing-List: contact crunch-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: crunch-dev@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of dlieu.7@gmail.com designates
 74.125.82.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAH29n6NuonD+JPaa_JrrRgh9eVtgEdky3Q_GTyd7AtYaw6k6=w@mail.gmail.com>
References: 
 <CAPud8Tq0hGYe2ZwWStY=sfvDQBqAEXefm3XsdKMAwPfRErvcjQ@mail.gmail.com>
	<CAH29n6NuonD+JPaa_JrrRgh9eVtgEdky3Q_GTyd7AtYaw6k6=w@mail.gmail.com>
Date: Wed, 17 Oct 2012 14:57:32 -0700
Message-ID: 
 <CAPud8ToY3JtGnzgGGYfdNxTZGg1gUysYMbiBLQs3epXuPF0GwQ@mail.gmail.com>
Subject: Re: Flume R -- any interest?
From: Dmitriy Lyubimov <dlieu.7@gmail.com>
To: crunch-dev@incubator.apache.org
Content-Type: text/plain; charset=ISO-8859-1

Ok maybe there's a benefit to try a JRI/RJava prototype on top of
Crunch for something simple. This should both save time and prove or
disprove if Crunch via RJava integration is viable.

On my part i can try to do it within Crunch framework or we can keep
it completely separate.

-d

On Wed, Oct 17, 2012 at 2:08 PM, Josh Wills <jwills@cloudera.com> wrote:
> I am an avid R user and would be into it-- who gave the talk? Was it
> Murray Stokely?
>
> On Wed, Oct 17, 2012 at 2:05 PM, Dmitriy Lyubimov <dlieu.7@gmail.com> wrote:
>> Hello,
>>
>> I was pretty excited to learn of Google's experience of R mapping of
>> flume java on one of recent BARUGs. I think a lot of applications
>> similar to what we do in Mahout could be prototyped using flume R.
>>
>> I did not quite get the details of Google implementation of R mapping,
>> but i am not sure if just a direct mapping from R to Crunch would be
>> sufficient (and, for most part, efficient). RJava/JRI and jni seem to
>> be a pretty terrible performer to do that directly.
>>
>>
>> on top of it, I am thinknig if this project could have a contributed
>> adapter to Mahout's distributed matrices, that would be just a very
>> good synergy.
>>
>> Is there anyone interested in contributing/advising for open source
>> version of flume R support? Just gauging interest, Crunch list seems
>> like a natural place to poke.
>>
>> Thanks .
>>
>> -Dmitriy
>
>
>
> --
> Director of Data Science
> Cloudera
> Twitter: @josh_wills