pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Angad Singh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2684) :: in field name causes AvroStorage to fail
Date Wed, 28 Nov 2012 14:26:59 GMT

    [ https://issues.apache.org/jira/browse/PIG-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505475#comment-13505475
] 

Angad Singh commented on PIG-2684:
----------------------------------

Has it occurred to anyone that due to this problem AvroStorage does not support storing pig
JOINs at all? Pig always uses ::'s in column names of JOIN's. AvroStorage completely fails
with pig JOINs. Epic fail.
                
> :: in field name causes AvroStorage to fail
> -------------------------------------------
>
>                 Key: PIG-2684
>                 URL: https://issues.apache.org/jira/browse/PIG-2684
>             Project: Pig
>          Issue Type: Bug
>          Components: piggybank
>            Reporter: Fabian Alenius
>
> There appears to be a bug in AvroStorage which causes it to fail when there are field
names that contain ::
> For example, the following will fail:
> data = load 'test.txt' as (one, two);
> grp = GROUP data by (one, two);
> result = foreach grp generate FLATTEN(group);                                       
                                                                                         
                                                 
> store result into 'test.avro' using org.apache.pig.piggybank.storage.avro.AvroStorage();
> ERROR 2999: Unexpected internal error. Illegal character in: group::one
> While the following will succeed:
> data = load 'test.txt' as (one, two);
> grp = GROUP data by (one, two);
> result = foreach grp generate FLATTEN(group) as (one,two);                          
                                                  
> store result into 'test.avro' using org.apache.pig.piggybank.storage.avro.AvroStorage();
> Here is a minimal test case:
> data = load 'test.txt' as (one::two, three);                                        
                                                                           
> store data into 'test.avro' using org.apache.pig.piggybank.storage.avro.AvroStorage();

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message