hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pengcheng Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14890) remove stat task generation from GenMapRedUtils.isMergeRequired
Date Wed, 05 Oct 2016 04:04:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547535#comment-15547535
] 

Pengcheng Xiong commented on HIVE-14890:
----------------------------------------

[~sershe], could u be more specific about the problem? isMergeRequired was first introduced
in 
{code}
commit 1fcfc31ea5c23aec3f3bf610e8938804a750ee5d
Author: Gunther Hagleitner <gunther@apache.org>
Date:   Mon Nov 4 01:34:01 2013 +0000

    HIVE-5734: Enable merge/move tasks for Tez (Gunther Hagleitner)

    git-svn-id: https://svn.apache.org/repos/asf/hive/branches/tez@1538485 13f79535-47bb-0310-9956-ffa450edef68
{code}

> remove stat task generation from GenMapRedUtils.isMergeRequired
> ---------------------------------------------------------------
>
>                 Key: HIVE-14890
>                 URL: https://issues.apache.org/jira/browse/HIVE-14890
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Pengcheng Xiong
>            Priority: Minor
>
> GenMapRedUtils.isMergeRequired method should not generate stats task... This kind of
pattern causes bugs that we have seen before when a change to a feature (e.g. merge in this
case - for example if on some paths isMergeRequired is not called, which would be a valid
change) would break a completely unrelated feature for no clear reason.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message