hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-925) Fix join in local mode
Date Tue, 18 Aug 2009 18:20:14 GMT

    [ https://issues.apache.org/jira/browse/PIG-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744628#action_12744628
] 

Pradeep Kamath commented on PIG-925:
------------------------------------

The new unit test has the following comment:
{code}
// Regression test for Pig-800
{code}

Shouldn't the jira number be PIG-925?

Changes look good - it would be good to have some 
comments at different parts of the code explaining
how we are translating LOJoin into POCogroup and foreach with flattens on the bag

I am assuming if the javac issue is fix-able, there will be a new patch with the fix.

+1 otherwise.

> Fix join in local mode
> ----------------------
>
>                 Key: PIG-925
>                 URL: https://issues.apache.org/jira/browse/PIG-925
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.3.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.4.0
>
>         Attachments: PIG-925-1.patch, PIG-925-2.patch, PIG-925-3.patch
>
>
> Join is broken after LOJoin patch (Optimizer_Phase5.patch of [PIG-697|https://issues.apache.org/jira/browse/PIG-697).
Even the simplest join script is not working under local mode:
> eg:
> a = load '1.txt';
> b = load '2.txt';
> c = join a by $0, b by $0;
> dump c;
> Caused by: java.lang.NullPointerException
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getNext(POPackage.java:206)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:231)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:191)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:231)
>         at org.apache.pig.backend.local.executionengine.physicalLayer.counters.POCounter.getNext(POCounter.java:71)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:231)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNext(POStore.java:117)
>         at org.apache.pig.backend.local.executionengine.LocalPigLauncher.runPipeline(LocalPigLauncher.java:146)
>         at org.apache.pig.backend.local.executionengine.LocalPigLauncher.launchPig(LocalPigLauncher.java:109)
>         at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:165)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message