hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14200) Tez: disable auto-reducer parallelism when reducer-count * min.partition.factor < 1.0
Date Sat, 09 Jul 2016 01:42:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368867#comment-15368867
] 

Gunther Hagleitner commented on HIVE-14200:
-------------------------------------------

Can we keep the inflation in these cases though? I know ppl using a large max factor esp to
over provision if there are only few reducers.

> Tez: disable auto-reducer parallelism when reducer-count * min.partition.factor <
1.0
> -------------------------------------------------------------------------------------
>
>                 Key: HIVE-14200
>                 URL: https://issues.apache.org/jira/browse/HIVE-14200
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gopal V
>            Assignee: Gopal V
>         Attachments: HIVE-14200.1.patch, HIVE-14200.2.patch
>
>
> The min/max factors offer no real improvement when the fractions are meaningless, for
example when 0.25 * 2  is applied as the min.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message