pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2970) Nested foreach getting incorrect schema when having unrelated inner query
Date Fri, 02 Nov 2012 15:41:12 GMT

     [ https://issues.apache.org/jira/browse/PIG-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Koji Noguchi updated PIG-2970:
------------------------------

    Attachment: pig-2970-trunk-v02.txt

bq. (from PIG-2119) LOGenerate is the only sink in nested plan. This is one of the basic assumption
we made throughout logical plan

Can we revisit this assumption to 'sink in nested plan includes a single LOGenerate and optional
dangling nodes'?  Attaching a patch that replaces foreach.getInnerPlan().getSinks().get(0)
to foreach.findGenearate() that I added.  Would something like this work?



                
> Nested foreach getting incorrect schema when having unrelated inner query
> -------------------------------------------------------------------------
>
>                 Key: PIG-2970
>                 URL: https://issues.apache.org/jira/browse/PIG-2970
>             Project: Pig
>          Issue Type: Bug
>          Components: parser
>    Affects Versions: 0.10.0
>            Reporter: Koji Noguchi
>            Assignee: Koji Noguchi
>            Priority: Minor
>             Fix For: 0.11, 0.12
>
>         Attachments: pig-2970-trunk-v01.txt, pig-2970-trunk-v02.txt
>
>
> While looking at PIG-2968, hit a weird error message.
> {noformat}
> $ cat -n test/foreach2.pig
>      1  daily = load 'nyse' as (exchange, symbol);
>      2  grpd = group daily by exchange;
>      3  unique = foreach grpd {
>      4          sym = daily.symbol;
>      5          uniq_sym = distinct sym;
>      6          --ignoring uniq_sym result
>      7          generate group, daily;
>      8  };
>      9  describe unique;
>     10  zzz = foreach unique generate group;
>     11  explain zzz;
> % pig -x local -t ColumnMapKeyPrune test/foreach2.pig
> ...
> unique: {symbol: bytearray}
> 2012-10-12 16:55:44,226 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1025: 
> <file test/foreach2.pig, line 10, column 30> Invalid field projection. Projected
field [group] does not exist in schema: symbol:bytearray.
> ...
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message