hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1127) Logical operator should contains individual copy of schema object
Date Mon, 07 Dec 2009 21:30:18 GMT

    [ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787126#action_12787126

Pradeep Kamath commented on PIG-1127:

Changes look good - I am wondering though if we can change the copy constructor in FieldSchema
to make copies of canonicalMap and ReverseCanonicalMap and then the code to setParent can
be removed from the patch.

> Logical operator should contains individual copy of schema object
> -----------------------------------------------------------------
>                 Key: PIG-1127
>                 URL: https://issues.apache.org/jira/browse/PIG-1127
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.4.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>         Attachments: PIG-1127-1.patch, PIG-1127-2.patch
> Currently some logical operator only contains a schema reference to the predecessor's
schema object. These logical operators include: LOSplitOutput, LOLimit, LOSplit, LOFilter,
LOSort, LODistinct, LOUnion. It is ok in the before because we do not change schema object
once it is set. Now with the column pruner (PIG-922), we need to change individual schema
object so it is no longer acceptable. For example, the following script fail:
> {code}
> a = load '1.txt' as (a0, a1:map[], a2);
> b = foreach a generate a1;
> c = limit b 10;
> dump c;
> {code}
> We need to fix it.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message