pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3293) Casting fails after Union from two data sources&loaders
Date Wed, 24 Apr 2013 16:01:16 GMT

    [ https://issues.apache.org/jira/browse/PIG-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640568#comment-13640568

Koji Noguchi commented on PIG-3293:

When two inputs are loaded by the same loader, this was handled at PIG-2493.

In the case here, I can understand 'funcSpec' would be null for Union/Cast since they are
coming from two loaders, but can we still use the caster if both loaders happen to have the
same one (Utf8StorageConverter)? 

> Casting fails after Union from two data sources&loaders
> -------------------------------------------------------
>                 Key: PIG-3293
>                 URL: https://issues.apache.org/jira/browse/PIG-3293
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Koji Noguchi
> Script similar to 
> {noformat}
> A = load 'data1' using MyLoader() as (a:bytearray);
> B = load 'data2' as (a:bytearray);
> C = union onschema A,B;
> D = foreach C generate (chararray)a;
> Store D into './out';
> {noformat}
> fails with 
>    java.lang.Exception: org.apache.pig.backend.executionengine.ExecException: ERROR 1075:
Received a bytearray from the UDF. Cannot determine how to convert the bytearray to string.
> Both MyLoader and PigStorage use the default Utf8StorageConverter.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message