Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 94712171E8 for ; Mon, 29 Sep 2014 19:55:34 +0000 (UTC) Received: (qmail 3093 invoked by uid 500); 29 Sep 2014 19:55:34 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 3023 invoked by uid 500); 29 Sep 2014 19:55:34 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 3005 invoked by uid 500); 29 Sep 2014 19:55:33 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 3002 invoked by uid 99); 29 Sep 2014 19:55:33 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Sep 2014 19:55:33 +0000 Date: Mon, 29 Sep 2014 19:55:33 +0000 (UTC) From: "Gunther Hagleitner (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-7389) Reduce number of metastore calls in MoveTask (when loading dynamic partitions) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-7389: ------------------------------------- Resolution: Fixed Status: Resolved (was: Patch Available) committed to trunk and hive-14 > Reduce number of metastore calls in MoveTask (when loading dynamic partitions) > ------------------------------------------------------------------------------ > > Key: HIVE-7389 > URL: https://issues.apache.org/jira/browse/HIVE-7389 > Project: Hive > Issue Type: Bug > Affects Versions: 0.14.0 > Reporter: Rajesh Balamohan > Assignee: Rajesh Balamohan > Priority: Critical > Labels: performance > Fix For: 0.14.0 > > Attachments: HIVE-7389.1.patch, HIVE-7389.2.patch, local_vm_testcase.txt > > > When the number of dynamic partitions to be loaded are high, the time taken for 'MoveTask' is greater than the actual job in some scenarios. It would be possible to reduce overall runtime by reducing the number of calls made to metastore from MoveTask operation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)