pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Woody Anderson (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2051) new LogicalSchema column prune code does not preserve type information for map subfields
Date Mon, 09 May 2011 18:20:03 GMT

     [ https://issues.apache.org/jira/browse/PIG-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Woody Anderson updated PIG-2051:
--------------------------------

    Attachment: 2051.patch

this patch propagates type information more correctly (though not recursive/fully) to the
pushProjection call.

Mainly, this means putting type information into via subfields into map types.

It doesn't fully descend and provide type information for subfields of subfields etc. But,
provided fields have the correct type information rather than DataType.BYTEARRAY


> new LogicalSchema column prune code does not preserve type information for map subfields
> ----------------------------------------------------------------------------------------
>
>                 Key: PIG-2051
>                 URL: https://issues.apache.org/jira/browse/PIG-2051
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.10
>            Reporter: Woody Anderson
>            Assignee: Woody Anderson
>             Fix For: 0.10
>
>         Attachments: 2051.patch
>
>
> current impl of ColumnPruneVisitor.visit ignores field type info and passes type BYTEARRAY
for all map fields.
> the corrected type is pretty easy to fill in, especially since map field info is only
attempted 1 level deep.
> i came across this b/c i utilize the type information in the pushProjection call, and
this was previously of the 'correct' type information, the change over to LogicalSchema caused
a regression.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message