pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allan AvendaƱo (JIRA) <j...@apache.org>
Subject [jira] [Commented] (PIG-2155) NPE thrown by ABS
Date Thu, 10 May 2012 07:35:15 GMT

    [ https://issues.apache.org/jira/browse/PIG-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13272155#comment-13272155
] 

Allan AvendaƱo commented on PIG-2155:
-------------------------------------

Hi Prashant,

My input file was this: 

grunt> cat data/abs
cat data/abs
A|1
B|2
<break line>
<spaces>


and output was this
(A,1.0,1.0)
(B,2.0,2.0)
(,,)
(        ,,)

and any exception was thrown as is described. 
If there are spaces or break lines in the input, should be shown in the output or not? 
                
> NPE thrown by ABS
> -----------------
>
>                 Key: PIG-2155
>                 URL: https://issues.apache.org/jira/browse/PIG-2155
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Shubham Chopra
>              Labels: newbie, simple
>
> Input data :
> --file 'a' starts--
> A|1
> B|2
> --file 'a' ends--
> (Note the empty line at the end)
> The following script does not work.
> a = load 'a' using PigStorage('|') as (x:chararray, y:double);
> b = foreach a generate *, ABS(y - 2*y) as test;
> dump b;
> The function ABS throws a NPE instead of giving out a null for the last line in the input:
> java.lang.NullPointerException
> 	at org.apache.pig.builtin.DoubleAbs.exec(DoubleAbs.java:45)
> 	at org.apache.pig.builtin.DoubleAbs.exec(DoubleAbs.java:28)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:216)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:281)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:324)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:332)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:284)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:261)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:256)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:58)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message