Return-Path: 
 <pig-dev-return-13977-apmail-hadoop-pig-dev-archive=hadoop.apache.org@hadoop.apache.org>
Delivered-To: apmail-hadoop-pig-dev-archive@www.apache.org
Received: (qmail 32064 invoked from network); 2 Apr 2010 18:32:37 -0000
Received: from unknown (HELO mail.apache.org) (140.211.11.3)
  by 140.211.11.9 with SMTP; 2 Apr 2010 18:32:37 -0000
Received: (qmail 52485 invoked by uid 500); 2 Apr 2010 18:32:36 -0000
Delivered-To: apmail-hadoop-pig-dev-archive@hadoop.apache.org
Received: (qmail 52444 invoked by uid 500); 2 Apr 2010 18:32:36 -0000
Mailing-List: contact pig-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:pig-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:pig-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:pig-dev@hadoop.apache.org>
List-Id: <pig-dev.hadoop.apache.org>
Reply-To: pig-dev@hadoop.apache.org
Delivered-To: mailing list pig-dev@hadoop.apache.org
Received: (qmail 52433 invoked by uid 99); 2 Apr 2010 18:32:36 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Apr 2010 18:32:36 +0000
X-ASF-Spam-Status: No, hits=2.2 required=10.0
	tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of hc.busy@gmail.com designates
 209.85.221.187 as permitted sender)
Received: from [209.85.221.187] (HELO mail-qy0-f187.google.com)
 (209.85.221.187)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Apr 2010 18:32:29 +0000
Received: by qyk17 with SMTP id 17so416000qyk.9
        for <multiple recipients>; Fri, 02 Apr 2010 11:32:08 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=domainkey-signature:mime-version:received:in-reply-to:references
         :date:received:message-id:subject:from:to:content-type;
        bh=A0IkqltS9vFllwJn7NyQFczwu8IfVtIzPA6E7zAUm6M=;
        b=JnPotTrouwAcqlDbwgpUY8L4ucU56dZP51KYZK1qAXYhjh6yFoyduZ5XOkArKDryH8
         c8zTPATXiQ35OfJZxiWYiBIjBegORHe3cMpWtPGZ0Gy6fFJJlm71ba94S/D9ov2fg7wt
         sVfVAZRBi0ogHLDnXHyUvbhbkkJsXy5oYAvQE=
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=DL72AMnERyiqXKV2ZAfv3dLL92Oa6XFBV6VdexjV+Jd+6003UJdVYkTMATmbee0cHk
         5kDnK/kVTkUCODkOQ/ecZ0VX2CFd80TUxr1lSnW2+sTX0JSEE5xwHEC/ON297TALf1PZ
         03gHI1l7ELff3F6rQSv8mQPi6gqp76NWNwwTk=
MIME-Version: 1.0
Received: by 10.229.51.7 with HTTP; Fri, 2 Apr 2010 11:32:06 -0700 (PDT)
In-Reply-To: <n2t2cbdb1fd1004021129o217a30e5yf953098b67fbfa75@mail.gmail.com>
References: <n2t2cbdb1fd1004021129o217a30e5yf953098b67fbfa75@mail.gmail.com>
Date: Fri, 2 Apr 2010 11:32:06 -0700
Received: by 10.229.38.147 with SMTP id b19mr4092293qce.102.1270233127091;
	Fri, 02 Apr 2010 11:32:07 -0700 (PDT)
Message-ID: <u2j2cbdb1fd1004021132l4c257146hb739275883ba1be3@mail.gmail.com>
Subject: Re: What should FLATTEN do?
From: hc busy <hc.busy@gmail.com>
To: pig-user@hadoop.apache.org, pig-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0016363b8be852f0230483453264
X-Virus-Checked: Checked by ClamAV on apache.org

--0016363b8be852f0230483453264
Content-Type: text/plain; charset=ISO-8859-1

doh!!!! s/map/bag/g

I seem to get maps and bags mixed up or some reason...

Guys, I have a row containing a *bag*

'id','data', {((1,2)), ((2,3)), ((4,5))}

What is the expected behavior when I flatten on that bag? I had expected it
to result in

'id','data', (1,2)
'id','data', (2,3)
'id','data', (4,5)


But it appears to me that the result of applying FLATTEN to that bag is this
instead:

'id','data', 1,2
'id','data', 2,3
'id','data', 4,5


The latter is returned by the current cloudera's CDH2 and I've seen the
prior behavior on other versions of pig.

Which is the correct behavior by design?

What will pig 0.6 do when it is released?

thanks!
On Fri, Apr 2, 2010 at 11:29 AM, hc busy <hc.busy@gmail.com> wrote:

> Guys, I have a row containing a map
>
> 'id','data', {((1,2)), ((2,3)), ((4,5))}
>
> What is the expected behavior when I flatten on that bag? I had expected it
> to result in
>
> 'id','data', (1,2)
> 'id','data', (2,3)
> 'id','data', (4,5)
>
>
> But it appears to me that the result of applying FLATTEN to that bag is
> this instead:
>
> 'id','data', 1,2
> 'id','data', 2,3
> 'id','data', 4,5
>
>
> The latter is returned by the current cloudera's CDH2 and I've seen the
> prior behavior on other versions of pig.
>
> Which is the correct behavior by design?
>
> What will pig 0.6 do when it is released?
>
> thanks!
>

--0016363b8be852f0230483453264--