hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1174) Job counter error if "hive.merge.mapfiles" equals true
Date Tue, 16 Feb 2010 23:01:30 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12834536#action_12834536
] 

He Yongqiang commented on HIVE-1174:
------------------------------------

The problem in this jira is:
1) countJobs in Driver only count map-reduce tasks. 
2) For mergeJob, there are two tasks (one dummyMove, and one merge task which is a MRTask).
It will count 1 job because dummyMove is not a MapReduceTask
3) But a bug in ConditionalTask will  always inc jobCounter by 1 when removing a task from
candidate task list, even though it is not a MRTask,

> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
>                 Key: HIVE-1174
>                 URL: https://issues.apache.org/jira/browse/HIVE-1174
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: hive-1174.1.patch, hive-1174.2.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message