Mailing-List: contact general-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of twgoetz@gmx.de designates
 213.165.64.20 as permitted sender)
Message-ID: <46F7525D.7020506@gmx.de>
Date: Mon, 24 Sep 2007 07:59:57 +0200
From: Thilo Goetz <twgoetz@gmx.de>
User-Agent: Thunderbird 2.0.0.6 (Windows/20070728)
MIME-Version: 1.0
To: general@incubator.apache.org
Subject: Re: Incubator Proposal: Pig
References: <009001c7fa2d$6e76f2f0$6d9015ac@ds.corp.yahoo.com>
 <200709231606.49621.niclas@hedhman.org>
In-Reply-To: <200709231606.49621.niclas@hedhman.org>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

Niclas Hedhman wrote:
[...]
> 
> b) I can't say that I understand the technical merits of the proposal, and 
> just see the headline "analyzing large data sets". And I would like to know 
> the relationship with UIMA's statement "... analyze large volumes of 
> unstructured information..." and hear whether there are overlap, synergies 
> and/or collaboration in view.

Niclas,

I'm not 100% clear on where there could be synergies between
Pig and UIMA.  Map/reduce is a natural distribution
strategy for UIMA, so executing UIMA programs on top of Hadoop
seems natural.  Maybe Pig can help with that and make it easier
somehow.  However, that is not clear to me from the proposal
at this time.

At the same time, I don't really think there is any overlap.
Pig is concerned with computation in a distributed environment,
while UIMA is agnostic in that respect.  On the other hand,
UIMA offers a component model to develop analysis modules and
combine them into processing chains (with an emphasis on reuse).
I do not see from the proposal that Pig is in the business of
defining a component model.

So synergies probably yes, no overlap as far as I can see.

--Thilo


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org