hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Vary (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14215) Displaying inconsistent CPU usage data with MR execution engine
Date Tue, 12 Jul 2016 14:04:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372929#comment-15372929
] 

Peter Vary commented on HIVE-14215:
-----------------------------------

And an here it is even worse:
{noformat}
2016-07-12 14:00:42,190 Stage-3 map = 0%,  reduce = 0%
2016-07-12 14:00:50,465 Stage-3 map = 67%,  reduce = 0%, Cumulative CPU 6.56 sec
MapReduce Total cumulative CPU time: 6 seconds 560 msec
Ended Job = job_1468321038188_0018
MapReduce Jobs Launched: 
Stage-Stage-3: Map: 3   Cumulative CPU: 10.26 sec   HDFS Read: 383060 HDFS Write: 6190612
SUCCESS
Total MapReduce CPU Time Spent: 10 seconds 260 msec
{noformat}

> Displaying inconsistent CPU usage data with MR execution engine
> ---------------------------------------------------------------
>
>                 Key: HIVE-14215
>                 URL: https://issues.apache.org/jira/browse/HIVE-14215
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 2.2.0
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>            Priority: Minor
>
> If the MR task is finished after printing the cumulative CPU time then there is the possibility
to print inconsistent CPU usage information.
> Correct one:
> {noformat}
> 2016-07-12 11:31:42,961 Stage-3 map = 0%,  reduce = 0%
> 2016-07-12 11:31:48,237 Stage-3 map = 100%,  reduce = 0%, Cumulative CPU 2.5 sec
> MapReduce Total cumulative CPU time: 2 seconds 500 msec
> Ended Job = job_1468321038188_0003
> MapReduce Jobs Launched: 
> Stage-Stage-3: Map: 1   Cumulative CPU: 2.5 sec   HDFS Read: 5864 HDFS Write: 103 SUCCESS
> Total MapReduce CPU Time Spent: 2 seconds 500 msec
> {noformat}
> One type of inconsistent data (easily reproducible one):
> {noformat}
> 2016-07-12 11:39:00,540 Stage-3 map = 0%,  reduce = 0%
> Ended Job = job_1468321038188_0004
> MapReduce Jobs Launched: 
> Stage-Stage-3: Map: 1   Cumulative CPU: 2.51 sec   HDFS Read: 5864 HDFS Write: 103 SUCCESS
> Total MapReduce CPU Time Spent: 2 seconds 510 msec
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message