Return-Path: X-Original-To: apmail-incubator-crunch-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-crunch-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0B35DD514 for ; Wed, 17 Oct 2012 21:06:16 +0000 (UTC) Received: (qmail 50724 invoked by uid 500); 17 Oct 2012 21:06:16 -0000 Delivered-To: apmail-incubator-crunch-dev-archive@incubator.apache.org Received: (qmail 50679 invoked by uid 500); 17 Oct 2012 21:06:15 -0000 Mailing-List: contact crunch-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: crunch-dev@incubator.apache.org Delivered-To: mailing list crunch-dev@incubator.apache.org Received: (qmail 50670 invoked by uid 99); 17 Oct 2012 21:06:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Oct 2012 21:06:15 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dlieu.7@gmail.com designates 74.125.82.175 as permitted sender) Received: from [74.125.82.175] (HELO mail-we0-f175.google.com) (74.125.82.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Oct 2012 21:06:08 +0000 Received: by mail-we0-f175.google.com with SMTP id t44so4718207wey.6 for ; Wed, 17 Oct 2012 14:05:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=V5Mobd8WnVFgklD4wx06EqVEaxC96FjB4/ycadBzS3k=; b=QoX7YAopL4u6gfCbWeA2/2EzPQhxs0/gk0Nl2ez6kNuds6xWMydWKvJ4bijF1BI2/v aR41IeJxk1+wGx9iEm3alJvlmG+Uznd+g+tYsNL85MSM41jw7A6Ynlzd5KLzK76+mRB5 Q7o23SBxbuwhOPMTsPoAsrInKCIZZvw+J00Wu4pfRXkqC3nTxG0wtA5Kv2ia3euatkwk AeBSsx0hUGpNIhn215fSFVClE7BWUnI5maF4HV6hTGrDUtx2FRyYC4SDN9LOrqAMASXT rlap4I1VJjQkk7CCvIYf3UeQMfs6EDQLv3EXrxqwc3txdX+Pe2jrmuMFWvxZ13U7GuZs gc+Q== MIME-Version: 1.0 Received: by 10.180.90.201 with SMTP id by9mr6535706wib.5.1350507947893; Wed, 17 Oct 2012 14:05:47 -0700 (PDT) Received: by 10.194.41.34 with HTTP; Wed, 17 Oct 2012 14:05:47 -0700 (PDT) Date: Wed, 17 Oct 2012 14:05:47 -0700 Message-ID: Subject: Flume R -- any interest? From: Dmitriy Lyubimov To: crunch-dev@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Hello, I was pretty excited to learn of Google's experience of R mapping of flume java on one of recent BARUGs. I think a lot of applications similar to what we do in Mahout could be prototyped using flume R. I did not quite get the details of Google implementation of R mapping, but i am not sure if just a direct mapping from R to Crunch would be sufficient (and, for most part, efficient). RJava/JRI and jni seem to be a pretty terrible performer to do that directly. on top of it, I am thinknig if this project could have a contributed adapter to Mahout's distributed matrices, that would be just a very good synergy. Is there anyone interested in contributing/advising for open source version of flume R support? Just gauging interest, Crunch list seems like a natural place to poke. Thanks . -Dmitriy