pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1771) New logical plan: Merge schema fail if LoadFunc.getSchema return different schema with "Load...AS"
Date Mon, 20 Dec 2010 18:43:02 GMT

    [ https://issues.apache.org/jira/browse/PIG-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973293#action_12973293
] 

Daniel Dai commented on PIG-1771:
---------------------------------

Patch committed to both trunk and 0.8 branch.

> New logical plan: Merge schema fail if LoadFunc.getSchema return different schema with
"Load...AS"
> --------------------------------------------------------------------------------------------------
>
>                 Key: PIG-1771
>                 URL: https://issues.apache.org/jira/browse/PIG-1771
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.8.0
>
>         Attachments: PIG-1771-1.patch, PIG-1771-2.patch, PIG-1771-3.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a3, a4:map[]);
> store a into '1.bin' using BinStorage();
> auxData = LOAD '1.bin' USING BinStorage('Utf8StorageConverter') AS (cookieId:chararray,
type:chararray, record:tuple(), state:map[]);
> dump auxData;
> {code}
> Error message:
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2246: Error merging
schema record#-1:tuple{} and null#-1:bytearray
>         at org.apache.pig.newplan.logical.relational.LogicalSchema.merge(LogicalSchema.java:337)
>         at org.apache.pig.newplan.logical.relational.LOLoad.getSchema(LOLoad.java:103)
>         at org.apache.pig.newplan.logical.optimizer.SchemaResetter.visit(SchemaResetter.java:59)
>         at org.apache.pig.newplan.logical.relational.LOLoad.accept(LOLoad.java:159)
>         at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
>         at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:261)
>         ... 12 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message