pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3293) Casting fails after Union from two data sources&loaders
Date Wed, 24 Apr 2013 16:01:16 GMT

    [ https://issues.apache.org/jira/browse/PIG-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640568#comment-13640568
] 

Koji Noguchi commented on PIG-3293:
-----------------------------------

When two inputs are loaded by the same loader, this was handled at PIG-2493.

In the case here, I can understand 'funcSpec' would be null for Union/Cast since they are
coming from two loaders, but can we still use the caster if both loaders happen to have the
same one (Utf8StorageConverter)? 


                
> Casting fails after Union from two data sources&loaders
> -------------------------------------------------------
>
>                 Key: PIG-3293
>                 URL: https://issues.apache.org/jira/browse/PIG-3293
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Koji Noguchi
>
> Script similar to 
> {noformat}
> A = load 'data1' using MyLoader() as (a:bytearray);
> B = load 'data2' as (a:bytearray);
> C = union onschema A,B;
> D = foreach C generate (chararray)a;
> Store D into './out';
> {noformat}
> fails with 
>    java.lang.Exception: org.apache.pig.backend.executionengine.ExecException: ERROR 1075:
Received a bytearray from the UDF. Cannot determine how to convert the bytearray to string.
> Both MyLoader and PigStorage use the default Utf8StorageConverter.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message