hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml
Date Mon, 25 May 2009 19:30:45 GMT

     [ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

He Yongqiang updated HIVE-490:
------------------------------

    Attachment: hive-490-2009-05-26.patch

Checked the code and found what i suspected in previous comment is right.  

> set mapred.reduce.tasks to -1 in hive-default.xml
> -------------------------------------------------
>
>                 Key: HIVE-490
>                 URL: https://issues.apache.org/jira/browse/HIVE-490
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Clients
>            Reporter: Joydeep Sen Sarma
>         Attachments: hive-490-2009-05-23-2.patch, hive-490-2009-05-23-3.patch, hive-490-2009-05-23.patch,
hive-490-2009-05-26.patch
>
>
> this is profoundly irritating. we can estimate reducers. but since hadoop-default.xml
sets this to '1' - by default we don't. if we expect most users to set this to -1 - then we
might as well set it to -1 ourselves.
> to not shoot ourselves in the foot - we might want to cap number of reducers based on
cluster size (like 2*Nodes).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message