pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allan Avendaño (JIRA) <j...@apache.org>
Subject [jira] [Commented] (PIG-2155) NPE thrown by ABS
Date Sun, 06 May 2012 10:21:54 GMT

    [ https://issues.apache.org/jira/browse/PIG-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269175#comment-13269175
] 

Allan Avendaño commented on PIG-2155:
-------------------------------------

I was trying to reproduce same scenario, but while I tried to run a file with empty space
and/or break lines at the end of the file, the result was something like this:

(1.0,A,1.0)
(2.0,B,2.0)
(,,)             <-- break line
(,     ,)        <-- empty space

And no exceptions were thrown. Maybe because I'm working on latest version, but in any case
this results are accepted?
                
> NPE thrown by ABS
> -----------------
>
>                 Key: PIG-2155
>                 URL: https://issues.apache.org/jira/browse/PIG-2155
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Shubham Chopra
>              Labels: newbie, simple
>
> Input data :
> --file 'a' starts--
> A|1
> B|2
> --file 'a' ends--
> (Note the empty line at the end)
> The following script does not work.
> a = load 'a' using PigStorage('|') as (x:chararray, y:double);
> b = foreach a generate *, ABS(y - 2*y) as test;
> dump b;
> The function ABS throws a NPE instead of giving out a null for the last line in the input:
> java.lang.NullPointerException
> 	at org.apache.pig.builtin.DoubleAbs.exec(DoubleAbs.java:45)
> 	at org.apache.pig.builtin.DoubleAbs.exec(DoubleAbs.java:28)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:216)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:281)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:324)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:332)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:284)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:261)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:256)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:58)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message