Return-Path: Delivered-To: apmail-hive-dev-archive@www.apache.org Received: (qmail 99380 invoked from network); 2 Feb 2011 17:33:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 2 Feb 2011 17:33:54 -0000 Received: (qmail 82949 invoked by uid 500); 2 Feb 2011 17:33:54 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 82775 invoked by uid 500); 2 Feb 2011 17:33:52 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 82767 invoked by uid 500); 2 Feb 2011 17:33:51 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 82764 invoked by uid 99); 2 Feb 2011 17:33:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Feb 2011 17:33:51 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Feb 2011 17:33:49 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id F1EF818A67B for ; Wed, 2 Feb 2011 17:33:28 +0000 (UTC) Date: Wed, 2 Feb 2011 17:33:28 +0000 (UTC) From: "Namit Jain (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: <408054996.5536.1296668008987.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <296297077.4552.1296629968982.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] Commented: (HIVE-1944) dynamic partition insert creating different directories for the same partition during merge MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989720#comment-12989720 ] Namit Jain commented on HIVE-1944: ---------------------------------- +1 > dynamic partition insert creating different directories for the same partition during merge > ------------------------------------------------------------------------------------------- > > Key: HIVE-1944 > URL: https://issues.apache.org/jira/browse/HIVE-1944 > Project: Hive > Issue Type: Bug > Reporter: Ning Zhang > Assignee: Ning Zhang > Attachments: HIVE-1944.patch > > > If dynamic partition insert generates multiple partitions and some partitions need to be merge (MR task) and some need not (move task), parallel execution could cause the move task finish first and created the partition directory (say ds=1) first. When the MR job finished, it created a different directory (ds=1_1) for the same partition ds=1. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira