Return-Path: X-Original-To: apmail-pig-dev-archive@www.apache.org Delivered-To: apmail-pig-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0C5D8EABC for ; Sat, 16 Feb 2013 00:12:12 +0000 (UTC) Received: (qmail 98055 invoked by uid 500); 16 Feb 2013 00:09:01 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 92369 invoked by uid 500); 16 Feb 2013 00:08:55 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 88011 invoked by uid 500); 16 Feb 2013 00:08:49 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org Received: (qmail 50798 invoked by uid 99); 15 Feb 2013 22:31:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Feb 2013 22:31:13 +0000 Date: Fri, 15 Feb 2013 22:31:13 +0000 (UTC) From: "Cheolsoo Park (JIRA)" To: pig-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (PIG-2553) Pig shouldn't allow attempts to write multiple relations into same directory MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/PIG-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13579552#comment-13579552 ] Cheolsoo Park commented on PIG-2553: ------------------------------------ [~prkommireddi], sorry for the delay. I am looking at it now. > Pig shouldn't allow attempts to write multiple relations into same directory > ---------------------------------------------------------------------------- > > Key: PIG-2553 > URL: https://issues.apache.org/jira/browse/PIG-2553 > Project: Pig > Issue Type: Improvement > Reporter: Dmitriy V. Ryaboy > Assignee: Prashant Kommireddi > Attachments: PIG-2553_1.patch, PIG-2553_2.patch, PIG-2553.patch > > > We've seen multiple occasions where users accidentally try to store 2 or more different relations to the same destination directory. Currently, this passes the Pig planner and fails on MR side due to concurrent attempts to create the same part file on the reducer. This is extremely confusing to the user, and hard to debug. > We should instead fail their scripts before they are even submitted, since we can identify the erroneous condition from the beginning. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira