pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anitha Raju (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PIG-2493) UNION causes casting issues
Date Fri, 27 Jan 2012 04:45:40 GMT
UNION causes casting issues
---------------------------

                 Key: PIG-2493
                 URL: https://issues.apache.org/jira/browse/PIG-2493
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.9.1, 0.10
            Reporter: Anitha Raju


Hi,

For the below script,

{code}
A = load '/user/anithar/ip' as (a);
B = load '/user/anithar/ip1' as (a);
C = union  A , B ;
D = foreach C generate (chararray)a;
dump D;
{code}

it gives casting error at runtime

{code}
org.apache.pig.backend.executionengine.ExecException: ERROR 1075: Received a bytearray from
the UDF. Cannot determine how to convert the bytearray to string.
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POCast.getNext(POCast.java:660)
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:322)
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:332)
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:284)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:267)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:262)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1082)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
{code}

It looks like in POCast.java the value of "funcSpec" is not getting any value(stays null when
there is a UNION involved), causing "caster" to get null and thus the exception.

The same works in 0.8 without any issue.

Regards,
Anitha


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message