hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Wang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1351) [Zebra] No type check when we write to the basic table
Date Thu, 15 Apr 2010 22:24:49 GMT

    [ https://issues.apache.org/jira/browse/PIG-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857579#action_12857579
] 

Chao Wang commented on PIG-1351:
--------------------------------

One clarification to my above comment: we also check the first non-null record for collection.

> [Zebra] No type check when we write to the basic table
> ------------------------------------------------------
>
>                 Key: PIG-1351
>                 URL: https://issues.apache.org/jira/browse/PIG-1351
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.7.0
>            Reporter: Chao Wang
>            Assignee: Chao Wang
>             Fix For: 0.8.0
>
>         Attachments: PIG-1351.patch
>
>
> In Zebra, we do not have any type check when writing to a basic table. 
> Say, we have a schema: "f1:int, f2:string",
> however we can write a tuple ("abc", 123) without any problem, which is definitely not
desirable.
> To overcome this problem, we decide to perform certain amount of type checking in Zebra
- We check the first row only for each writer.
> This only serves as a sanity check purpose in cases where users screw up specifying the
output schema. We do NOT perform a rigorous type checking for all rows for apparently performance
concerns.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message