pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (PIG-2385) Store statements not getting processed
Date Sun, 04 Dec 2011 07:10:40 GMT

     [ https://issues.apache.org/jira/browse/PIG-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Daniel Dai resolved PIG-2385.

      Resolution: Fixed
    Hadoop Flags: Reviewed

Unit tests pass. test-patch: 
     [exec] -1 overall.  
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec]     -1 release audit.  The applied patch generated 463 release audit warnings
(more than the trunk's current 456 warnings).

No new file added, ignore release audit warning.

Patch committed to trunk/0.10/0.11
> Store statements not getting processed
> --------------------------------------
>                 Key: PIG-2385
>                 URL: https://issues.apache.org/jira/browse/PIG-2385
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.1
>            Reporter: Vivek Padmanabhan
>            Assignee: Daniel Dai
>            Priority: Critical
>             Fix For: 0.9.2
>         Attachments: PIG-2385-0.patch, PIG-2385-1.patch
> The actual script in which we got this issue is pretty big and complex. The script has
total 4 STORE statements and one of the STORE statement is not getting executed.
> The script executes 3 sets of jobs (excluding one STORE which is not getting executed)
consisting of 10, 11 and 19 jobs.
> The below script could be used to illustrate the issue but with Multiquery turned off;
> {code}
> A = LOAD 'input1' as (f1:chararray,f2:chararray,f3:chararray);
> Z = group A all;
> Z1 = foreach Z generate COUNT(A) as count;
> B = foreach A generate f1,f2,f3,(100-Z1.count) as diff;
> C = order B by diff;
> STORE C INTO 'output/C_out';
> store D into 'output/F_out';
> {code}
> For this script, if run with Multiquery turned off, the Store command for D is not getting
> I can see that the statements are getting parsed and LOStore created for D , but still,
it is not getting executed.
> The above script works fine with Pig 0.8.(This issue still exists in Trunk as well)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message