Mailing-List: contact dev-help@pig.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@pig.apache.org
Date: Fri, 5 Apr 2013 21:49:18 +0000 (UTC)
From: "Daniel Dai (JIRA)" <jira@apache.org>
To: pig-dev@hadoop.apache.org
Message-ID: <JIRA.12616902.1353400144167.119456.1365198558890@arcas>
In-Reply-To: <JIRA.12616902.1353400144167@arcas>
References: <JIRA.12616902.1353400144167@arcas>
Subject: [jira] [Updated] (PIG-3060) FLATTEN in nested foreach fails when
 the input contains an empty bag
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/PIG-3060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-3060:
----------------------------

    Attachment: PIG-3060-1.patch

There could be several fixes. The most proper fix I feel is to fix the way we flatten a bag. If we run out of a bag, return EOP instead of NULL. Running tests.
                
> FLATTEN in nested foreach fails when the input contains an empty bag
> --------------------------------------------------------------------
>
>                 Key: PIG-3060
>                 URL: https://issues.apache.org/jira/browse/PIG-3060
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.10.0
>            Reporter: Youngwook Kim
>         Attachments: PIG-3060-1.patch
>
>
> FLATTEN inside a foreach statement produces wrong results, if the input contains an empty bag.
> {code}
> A = load 'flatten.txt' as (a0:int, a1:bag{(t:chararray)});
> B = group A by a0;
> C = foreach B {
>   c1 = foreach A generate FLATTEN(a1);
>   generate COUNT(c1);
> };
> {code}
> The easy workaround is to filter out empty bags.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira