Return-Path: X-Original-To: apmail-incubator-crunch-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-crunch-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 54EE1D540 for ; Wed, 17 Oct 2012 21:11:24 +0000 (UTC) Received: (qmail 64931 invoked by uid 500); 17 Oct 2012 21:11:24 -0000 Delivered-To: apmail-incubator-crunch-dev-archive@incubator.apache.org Received: (qmail 64909 invoked by uid 500); 17 Oct 2012 21:11:24 -0000 Mailing-List: contact crunch-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: crunch-dev@incubator.apache.org Delivered-To: mailing list crunch-dev@incubator.apache.org Received: (qmail 64899 invoked by uid 99); 17 Oct 2012 21:11:24 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Oct 2012 21:11:24 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dlieu.7@gmail.com designates 209.85.212.171 as permitted sender) Received: from [209.85.212.171] (HELO mail-wi0-f171.google.com) (209.85.212.171) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Oct 2012 21:11:17 +0000 Received: by mail-wi0-f171.google.com with SMTP id hj13so945671wib.0 for ; Wed, 17 Oct 2012 14:10:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=G2acvQxfdFbGHBfxp94txf/I8HUvERhGHXtHOLFYMp0=; b=DMj5Q332ekR0QhXBdwhRy6I2n5qI4nDTd/5Q+9m9FRsWWVMv/XQrYr8dcaLCYxHk0g 5I7utAjp4nZIfTjTajG4zM2Nd+i1q3V24uWP+47ABIfef4Y85BbsKL6QkThKZsfNB/jW pJ48iqK3AbmyDMkJ905fu4gT3sQIfkymDmFQAO7Kj7wY4aBKJxH/L2A6TNvUuAxOY2h7 /Ozm3qUuzAffwa7NLSAdqch6s3el03b9bFQ7L6Vi4LPUTmjvnVEh/CBGIa7eEhB48ohr K7XLnbDJGNRLzGnbm3AQdLVvtP98Gb5JIMl4URTkqe6n41OZDv1WIH/FZPnaJ4l5H9BH YEzg== MIME-Version: 1.0 Received: by 10.216.207.160 with SMTP id n32mr12589338weo.61.1350508257238; Wed, 17 Oct 2012 14:10:57 -0700 (PDT) Received: by 10.194.41.34 with HTTP; Wed, 17 Oct 2012 14:10:57 -0700 (PDT) In-Reply-To: References: Date: Wed, 17 Oct 2012 14:10:57 -0700 Message-ID: Subject: Re: Flume R -- any interest? From: Dmitriy Lyubimov To: crunch-dev@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Karl Millar On Wed, Oct 17, 2012 at 2:08 PM, Josh Wills wrote: > I am an avid R user and would be into it-- who gave the talk? Was it > Murray Stokely? > > On Wed, Oct 17, 2012 at 2:05 PM, Dmitriy Lyubimov wrote: >> Hello, >> >> I was pretty excited to learn of Google's experience of R mapping of >> flume java on one of recent BARUGs. I think a lot of applications >> similar to what we do in Mahout could be prototyped using flume R. >> >> I did not quite get the details of Google implementation of R mapping, >> but i am not sure if just a direct mapping from R to Crunch would be >> sufficient (and, for most part, efficient). RJava/JRI and jni seem to >> be a pretty terrible performer to do that directly. >> >> >> on top of it, I am thinknig if this project could have a contributed >> adapter to Mahout's distributed matrices, that would be just a very >> good synergy. >> >> Is there anyone interested in contributing/advising for open source >> version of flume R support? Just gauging interest, Crunch list seems >> like a natural place to poke. >> >> Thanks . >> >> -Dmitriy > > > > -- > Director of Data Science > Cloudera > Twitter: @josh_wills