From dev-return-25176-apmail-pig-dev-archive=pig.apache.org@pig.apache.org Mon Dec 5 18:41:05 2011 Return-Path: X-Original-To: apmail-pig-dev-archive@www.apache.org Delivered-To: apmail-pig-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E31A3718E for ; Mon, 5 Dec 2011 18:41:04 +0000 (UTC) Received: (qmail 34520 invoked by uid 500); 5 Dec 2011 18:41:04 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 34295 invoked by uid 500); 5 Dec 2011 18:41:03 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 34284 invoked by uid 500); 5 Dec 2011 18:41:03 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org Received: (qmail 34276 invoked by uid 99); 5 Dec 2011 18:41:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Dec 2011 18:41:03 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Dec 2011 18:41:01 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 24BF2C6121 for ; Mon, 5 Dec 2011 18:40:40 +0000 (UTC) Date: Mon, 5 Dec 2011 18:40:40 +0000 (UTC) From: "Olga Natkovich (Commented) (JIRA)" To: pig-dev@hadoop.apache.org Message-ID: <62126724.41822.1323110440151.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1909846991.5397.1322035540401.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (PIG-2385) Store statements not getting processed MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162933#comment-13162933 ] Olga Natkovich commented on PIG-2385: ------------------------------------- What are the conditions under which the issue observed? Also, I assume not even an empty directory created when a store is missed, is this correct? > Store statements not getting processed > -------------------------------------- > > Key: PIG-2385 > URL: https://issues.apache.org/jira/browse/PIG-2385 > Project: Pig > Issue Type: Bug > Affects Versions: 0.9.1 > Reporter: Vivek Padmanabhan > Assignee: Daniel Dai > Priority: Critical > Fix For: 0.10, 0.9.2, 0.11 > > Attachments: PIG-2385-0.patch, PIG-2385-1.patch > > > The actual script in which we got this issue is pretty big and complex. The script has total 4 STORE statements and one of the STORE statement is not getting executed. > The script executes 3 sets of jobs (excluding one STORE which is not getting executed) consisting of 10, 11 and 19 jobs. > The below script could be used to illustrate the issue but with Multiquery turned off; > {code} > A = LOAD 'input1' as (f1:chararray,f2:chararray,f3:chararray); > Z = group A all; > Z1 = foreach Z generate COUNT(A) as count; > B = foreach A generate f1,f2,f3,(100-Z1.count) as diff; > C = order B by diff; > STORE C INTO 'output/C_out'; > D = DISTINCT C ; > store D into 'output/F_out'; > {code} > For this script, if run with Multiquery turned off, the Store command for D is not getting executed. > I can see that the statements are getting parsed and LOStore created for D , but still, it is not getting executed. > The above script works fine with Pig 0.8.(This issue still exists in Trunk as well) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira