Return-Path: X-Original-To: apmail-incubator-ambari-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-ambari-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7375411DA7 for ; Mon, 13 May 2013 17:28:44 +0000 (UTC) Received: (qmail 1804 invoked by uid 500); 13 May 2013 17:21:17 -0000 Delivered-To: apmail-incubator-ambari-dev-archive@incubator.apache.org Received: (qmail 1774 invoked by uid 500); 13 May 2013 17:21:17 -0000 Mailing-List: contact ambari-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: ambari-dev@incubator.apache.org Delivered-To: mailing list ambari-dev@incubator.apache.org Received: (qmail 1658 invoked by uid 99); 13 May 2013 17:21:17 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 May 2013 17:21:17 +0000 Date: Mon, 13 May 2013 17:21:17 +0000 (UTC) From: "Sumit Mohanty (JIRA)" To: ambari-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (AMBARI-2116) Add parameters to improve HIVE performance MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/AMBARI-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13656138#comment-13656138 ] Sumit Mohanty commented on AMBARI-2116: --------------------------------------- We also need to change HDPLocal. > Add parameters to improve HIVE performance > ------------------------------------------ > > Key: AMBARI-2116 > URL: https://issues.apache.org/jira/browse/AMBARI-2116 > Project: Ambari > Issue Type: Bug > Components: controller > Affects Versions: 1.3.1 > Reporter: Siddharth Wagle > Assignee: Siddharth Wagle > Fix For: 1.3.1 > > Attachments: AMBARI-2116.patch > > > This bug captures the set of configurations for hive and hadoop and the default values that are required for better/correct performance. > Here are the setting Ambari should use for hive-site.xml. > set hive.enforce.bucketing=true; > set hive.enforce.sorting=true; > set hive.map.aggr=true; > set hive.optimize.bucketmapjoin=true; > set hive.optimize.bucketmapjoin.sortedmerge=true; > set hive.mapred.reduce.tasks.speculative.execution=false; > set hive.auto.convert.join=true; > set hive.auto.convert.sortmerge.join=true; > set hive.auto.convert.sortmerge.join.noconditionaltask=true; > set hive.auto.convert.join.noconditionaltask=true; > set hive.auto.convert.join.noconditionaltask.size=1000000000; > set hive.optimize.reducededuplication.min.reducer=1; > set hive.optimize.mapjoin.mapreduce=true; > set hive.mapjoin.bucket.cache.size=10000; -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira