hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml
Date Sat, 23 May 2009 09:47:46 GMT

     [ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

He Yongqiang updated HIVE-490:

    Attachment: hive-490-2009-05-23-3.patch

hive-490-2009-05-23-3.patch includes parameters added in Hive-105. Thanks, Zheng.
Btw, this is the first step - auto inferring the maximum number of reducers can be done later.

> set mapred.reduce.tasks to -1 in hive-default.xml
> -------------------------------------------------
>                 Key: HIVE-490
>                 URL: https://issues.apache.org/jira/browse/HIVE-490
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Clients
>            Reporter: Joydeep Sen Sarma
>         Attachments: hive-490-2009-05-23-2.patch, hive-490-2009-05-23-3.patch, hive-490-2009-05-23.patch
> this is profoundly irritating. we can estimate reducers. but since hadoop-default.xml
sets this to '1' - by default we don't. if we expect most users to set this to -1 - then we
might as well set it to -1 ourselves.
> to not shoot ourselves in the foot - we might want to cap number of reducers based on
cluster size (like 2*Nodes).

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message