hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (PIG-769) COUNT fails on local mode but executes correctly on grid mode for the same data
Date Sat, 10 Jul 2010 00:27:49 GMT

     [ https://issues.apache.org/jira/browse/PIG-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Olga Natkovich resolved PIG-769.
--------------------------------

    Fix Version/s: 0.7.0
       Resolution: Fixed

Local mode now uses the same code path as MR mode. Please, re-open if this is till a problem.

> COUNT fails on local mode but executes correctly on grid mode for the same data
> -------------------------------------------------------------------------------
>
>                 Key: PIG-769
>                 URL: https://issues.apache.org/jira/browse/PIG-769
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.2.0
>            Reporter: George Mavromatis
>             Fix For: 0.7.0
>
>
> The following script run on the grid executes correctly. It  prints (4L) for '/user/gmavr/k_sample_preprocessed_withj_sample'
> On local mode (invoked with -x local) and the same data in the local filesystem, it failes
with:
> -2009-04-11 03:23:15,155 [main] ERROR org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore
- Received error from storer function: org.apache.pig.backend.executionengine.ExecException:
ERROR 2106: Error while computing count in COUNT
> %declare k_sample_preprocessed_withj '/user/gmavr/k_sample_preprocessed_withj_sample';
> -- %declare k_sample_preprocessed_withj '/homes/gmavr/mlrSite/k_sample_preprocessed_withj_sample';
> webdataFiltered = LOAD '$k_sample_preprocessed_withj' USING BinStorage() AS (url:chararray,
pg:bytearray);
> X1 = GROUP webdataFiltered ALL;
> Y1 = FOREACH X1 GENERATE COUNT(*);
> DUMP Y1;

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message