From user-return-13250-apmail-mahout-user-archive=mahout.apache.org@mahout.apache.org Thu May 3 04:36:02 2012 Return-Path: X-Original-To: apmail-mahout-user-archive@www.apache.org Delivered-To: apmail-mahout-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4CE25CD04 for ; Thu, 3 May 2012 04:36:02 +0000 (UTC) Received: (qmail 14367 invoked by uid 500); 3 May 2012 04:36:00 -0000 Delivered-To: apmail-mahout-user-archive@mahout.apache.org Received: (qmail 14226 invoked by uid 500); 3 May 2012 04:35:58 -0000 Mailing-List: contact user-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mahout.apache.org Delivered-To: mailing list user@mahout.apache.org Received: (qmail 14196 invoked by uid 99); 3 May 2012 04:35:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 May 2012 04:35:57 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ted.dunning@gmail.com designates 209.85.213.170 as permitted sender) Received: from [209.85.213.170] (HELO mail-yx0-f170.google.com) (209.85.213.170) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 May 2012 04:35:49 +0000 Received: by yenl5 with SMTP id l5so2910133yen.1 for ; Wed, 02 May 2012 21:35:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=pbx6ipoB9zzmQuIt7MbJqcqjRc5XFxvCHxDdvsR6UDY=; b=hMrtelR/y1zHq9G2Nkp4U+fvahd8BiiW+d/GKTEOb+MNQcDmebp5Eejnr0EplQtnfs WYw6++SfAoSgMnKFECD8GEDFd89dmWV7X+uWwZNDhiLSRlC7FZaaqpdt5gM/NpTdXPXU bKilrEgfuw841dkxFTumfIbsGJS20WGld4SboXiKnQKlugb4M2mfZ3FkEyPNQ81F5cf+ mAOy/9ywVVUR9qcXeV/v83Gpy4H5fCuSsSO+8RKZxoAI9BVtl5TgjQudcTPrKgJlYbQj K+mJnSEdmOdnIHnf3fvWxlLT5WocktD039J2WkTgcAh00gFEdQofvVlXCA1LIxMXpWyP 9cJA== Received: by 10.236.118.131 with SMTP id l3mr806493yhh.82.1336019728339; Wed, 02 May 2012 21:35:28 -0700 (PDT) MIME-Version: 1.0 Received: by 10.236.178.7 with HTTP; Wed, 2 May 2012 21:34:58 -0700 (PDT) In-Reply-To: References: From: Ted Dunning Date: Wed, 2 May 2012 21:34:58 -0700 Message-ID: Subject: Re: Mahout - Pig Hackday To: user@mahout.apache.org Content-Type: multipart/alternative; boundary=20cf3011d8d352123604bf1a5563 --20cf3011d8d352123604bf1a5563 Content-Type: text/plain; charset=UTF-8 On Wed, May 2, 2012 at 9:05 PM, Jake Mannix wrote: > On Wed, May 2, 2012 at 8:07 PM, Ted Dunning wrote: > > > Making a pig module for mahout is a fine idea. The twitter guys may have > > something better, though, so we should explore that as well. Andy's > > comments make that possibility very interesting. > > > > What I'd want to suggest is that anyone who wants to move rapidly on > pig/mahout > integration should start a github repo which doesn't directly inject itself > into mahout, > but stands separately for now, but then the maven dependency DAG rears its > ugly head: > > pig-vector depends on mahout-core > > so if we *do* want to start writing cool stuff *in mahout* which depends on > it, > I think that we are fine if we just create a pig module in mahout. It can depend on the external stuff and mahout-core. That would be the natural time and place to put the fancy pig-vector-ish stuff anyway. So I am not worried about this. We would have separation of mahout-pig stuff from mahout-core-ish stuff and all should be fine. > we're circularly dependently self-destruct. Now, if we had a proper > mahout-writables > maven module (*ahem*!), which had all the stuff pig-vector needed, and > mahout-core > depended on this, then mahout-core (or mahout-examples) could still depend > on > pig-vector (or something like it, like the elephant-bird-loaders slim dep) > at some > point. > I would rather not have Mahout depend on unreleased github stuff. If it is good enough to depend on, it is good enough to suck into the main deliverable. --20cf3011d8d352123604bf1a5563--