pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Daniels (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2275) NullPointerException from ILLUSTRATE
Date Sat, 10 Sep 2011 19:35:08 GMT

    [ https://issues.apache.org/jira/browse/PIG-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102120#comment-13102120
] 

Doug Daniels commented on PIG-2275:
-----------------------------------

Good catch.  I changed to:

<code>
A = load 'webcrawl' USING PigStorage('\t') AS ( url: chararray, pagerank: float, links:{ link:
( url: chararray ) } );
B = filter A by url is not null;
store B into 'output';
</code>

Same problem though, still an NPE in the same place.

> NullPointerException from ILLUSTRATE
> ------------------------------------
>
>                 Key: PIG-2275
>                 URL: https://issues.apache.org/jira/browse/PIG-2275
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Doug Daniels
>
> I'm getting a NullPointerException from ILLUSTRATE on a simple script using the webcrawl
data from the "Programming Pig" book: https://github.com/alanfgates/programmingpig/blob/master/data/webcrawl
> The script is:
> {code}
> A = load 'webcrawl' USING PigStorage('\t') AS ( url: chararray, pagerank: float, links:{
link: ( url: chararray ) } );
> B = filter A by url is not null;
> C = store B into 'output';
> {code}
> The stack trace I'm getting is:
> {code}
> java.lang.NullPointerException
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.illustratorMarkup(POFilter.java:200)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:155)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:290)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNext(POStore.java:138)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:261)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:256)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:58)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> 	at org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:194)
> 	at org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257)
> 	at org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238)
> 	at org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.java:103)
> 	at org.apache.pig.pen.LineageTrimmingVisitor.<init>(LineageTrimmingVisitor.java:98)
> 	at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:166)
> 	at org.apache.pig.PigServer.getExamples(PigServer.java:1258)
> 	at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:698)
> 	at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScriptParser.java:591)
> 	at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:306)
> 	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> 	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> 	at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> 	at org.apache.pig.Main.run(Main.java:456)
> 	at org.apache.pig.Main.main(Main.java:108)
> {code}
> I'm running this in local mode, though I don't know if it makes a difference.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message