pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prashant Kommireddi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2155) NPE thrown by ABS
Date Thu, 10 May 2012 07:42:45 GMT

    [ https://issues.apache.org/jira/browse/PIG-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13272159#comment-13272159
] 

Prashant Kommireddi commented on PIG-2155:
------------------------------------------

I think the <space> is coming from projecting all fields (*)

{code}
b = foreach a generate *, ABS(y - 2*y) as test;
{code}

Since the script is parsing on '|', it makes sense that space char is output.
                
> NPE thrown by ABS
> -----------------
>
>                 Key: PIG-2155
>                 URL: https://issues.apache.org/jira/browse/PIG-2155
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Shubham Chopra
>              Labels: newbie, simple
>
> Input data :
> --file 'a' starts--
> A|1
> B|2
> --file 'a' ends--
> (Note the empty line at the end)
> The following script does not work.
> a = load 'a' using PigStorage('|') as (x:chararray, y:double);
> b = foreach a generate *, ABS(y - 2*y) as test;
> dump b;
> The function ABS throws a NPE instead of giving out a null for the last line in the input:
> java.lang.NullPointerException
> 	at org.apache.pig.builtin.DoubleAbs.exec(DoubleAbs.java:45)
> 	at org.apache.pig.builtin.DoubleAbs.exec(DoubleAbs.java:28)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:216)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:281)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:324)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:332)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:284)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:261)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:256)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:58)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message