hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ankur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1274) Column pruning throws Null pointer exception
Date Wed, 03 Mar 2010 07:46:27 GMT

    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840514#action_12840514
] 

Ankur commented on PIG-1274:
----------------------------

Here is a script to reproduce the error

====== pig script  =========

R1 = load 'data1' as (a:chararray, b:chararray, c:chararray, d:chararray);
R2 = load 'data2' as (x:chararray, y:chararray, z:chararray);
joined = join R1 by c, R2 by z;
projected = FOREACH joined generate c, d;
dump projected;

===== data 1==========
a	b
====== data 2 ==========
a	b	c
a	t	d
a	x	e

The exception log is


ERROR 1002: Unable to store alias projected

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for
alias projected
	at org.apache.pig.PigServer.openIterator(PigServer.java:482)
	at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:552)
	at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:241)
	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
...
...
Caused by: java.lang.NullPointerException
	at org.apache.pig.data.DefaultTuple.get(DefaultTuple.java:143)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:149)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:234)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POCast.getNext(POCast.java:615)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:364)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:288)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:260)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNext(POLocalRearrange.java:256)
	at org.apache.pig.backend.local.executionengine.physicalLayer.relationalOperators.POCogroup.accumulateData(POCogroup.java:177)
	at org.apache.pig.backend.local.executionengine.physicalLayer.relationalOperators.POCogroup.getNext(POCogroup.java:96)

> Column pruning throws Null pointer exception
> --------------------------------------------
>
>                 Key: PIG-1274
>                 URL: https://issues.apache.org/jira/browse/PIG-1274
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Ankur
>
> In case data has missing values for certain columns in a relation participating in a
join, column pruning throws null pointer exception.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message