incubator-ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yusaku Sako (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AMBARI-2116) Add parameters to improve HIVE performance
Date Tue, 14 May 2013 21:13:17 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yusaku Sako updated AMBARI-2116:
--------------------------------

    Fix Version/s:     (was: 1.2.3)
                   1.2.4
    
> Add parameters to improve HIVE performance
> ------------------------------------------
>
>                 Key: AMBARI-2116
>                 URL: https://issues.apache.org/jira/browse/AMBARI-2116
>             Project: Ambari
>          Issue Type: Bug
>          Components: controller
>    Affects Versions: 1.2.2
>            Reporter: Siddharth Wagle
>            Assignee: Siddharth Wagle
>             Fix For: 1.2.4
>
>         Attachments: AMBARI-2116-1.patch, AMBARI-2116-2.patch, AMBARI-2116.patch
>
>
> This bug captures the set of configurations for hive and hadoop and the default values
that are required for better/correct performance.
> Here are the setting Ambari should use for hive-site.xml.
> set hive.enforce.bucketing=true;
> set hive.enforce.sorting=true;
> set hive.map.aggr=true;
> set hive.optimize.bucketmapjoin=true;
> set hive.optimize.bucketmapjoin.sortedmerge=true;
> set hive.mapred.reduce.tasks.speculative.execution=false;
> set hive.auto.convert.join=true;
> set hive.auto.convert.sortmerge.join=true;
> set hive.auto.convert.sortmerge.join.noconditionaltask=true;
> set hive.auto.convert.join.noconditionaltask=true;
> set hive.auto.convert.join.noconditionaltask.size=1000000000;
> set hive.optimize.reducededuplication.min.reducer=1;
> set hive.optimize.mapjoin.mapreduce=true;
> set hive.mapjoin.bucket.cache.size=10000;

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message