pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Wang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1351) [Zebra] No type check when we write to the basic table
Date Wed, 07 Apr 2010 16:51:33 GMT

    [ https://issues.apache.org/jira/browse/PIG-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854595#action_12854595
] 

Chao Wang commented on PIG-1351:
--------------------------------

1) We follow Java's type compatibility rule as follows:
For int type column, we allow int data instances.
For long type column, we allow int and long data instances.
For float type column, we allow int, long and float data instances.
For double type column, we allow int, long, float and double data instances.

2) Also, due to the limitation that Pig only supports BYTES for map value type, we do not
check inside of a map if it's BYTES type, else we do check.

> [Zebra] No type check when we write to the basic table
> ------------------------------------------------------
>
>                 Key: PIG-1351
>                 URL: https://issues.apache.org/jira/browse/PIG-1351
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.6.0, 0.7.0, 0.8.0
>            Reporter: Chao Wang
>            Assignee: Chao Wang
>             Fix For: 0.8.0
>
>         Attachments: PIG-1351.patch
>
>
> In Zebra, we do not have any type check when writing to a basic table. 
> Say, we have a schema: "f1:int, f2:string",
> however we can write a tuple ("abc", 123) without any problem, which is definitely not
desirable.
> To overcome this problem, we decide to perform certain amount of type checking in Zebra
- We check the first row only for each writer.
> This only serves as a sanity check purpose in cases where users screw up specifying the
output schema. We do NOT perform a rigorous type checking for all rows for apparently performance
concerns.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message