hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1112) FLATTEN eliminates the alias
Date Mon, 20 Sep 2010 18:25:33 GMT

    [ https://issues.apache.org/jira/browse/PIG-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12912624#action_12912624

Alan Gates commented on PIG-1112:

In the example above, the user specified that he expects two fields to come out of the flatten
of ladder.  This seems equivalent to saying A = load 'ladder' as (third, second).  So I propose
that when users give field names (and possibly types) in an AS that is attached to a flatten
Pig takes that to be the schema of the flattened data.

> FLATTEN eliminates the alias
> ----------------------------
>                 Key: PIG-1112
>                 URL: https://issues.apache.org/jira/browse/PIG-1112
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Ankur
>            Assignee: Alan Gates
>             Fix For: 0.9.0
> If schema for a field of type 'bag' is partially defined then FLATTEN() incorrectly eliminates
the field and throws an error. 
> Consider the following example:-
> A = LOAD 'sample' using PigStorage() as (first:chararray, second:chararray, ladder:bag{});
> B = FOREACH A GENERATE first,FLATTEN(ladder) as third,second;                       
> C = GROUP B by (first,third);
> This throws the error
>  ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1000: Error during parsing. Invalid alias:
third in {first: chararray,second: chararray}

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message