hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12512) Include driver logs in execution-level Operation logs
Date Wed, 25 Nov 2015 22:59:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027751#comment-15027751
] 

Xuefu Zhang commented on HIVE-12512:
------------------------------------

+1 on test.

> Include driver logs in execution-level Operation logs
> -----------------------------------------------------
>
>                 Key: HIVE-12512
>                 URL: https://issues.apache.org/jira/browse/HIVE-12512
>             Project: Hive
>          Issue Type: Bug
>          Components: Logging
>            Reporter: Mohit Sabharwal
>            Assignee: Mohit Sabharwal
>            Priority: Minor
>         Attachments: HIVE-12512.patch
>
>
> When {{hive.server2.logging.operation.level}} is set to {{EXECUTION}} (default),  operation
logs do not include Driver logs, which contain useful info like total number of jobs launched,
stage getting executed, etc. that help track high-level progress. It only adds a few more
lines to the output.
> {code}
> 15/11/24 14:09:12 INFO ql.Driver: Semantic Analysis Completed
> 15/11/24 14:09:12 INFO ql.Driver: Starting command(queryId=hive_20151124140909_e8cbb9bd-bac0-40b2-83d0-382de25b80d1):
select count(*) from sample_08
> 15/11/24 14:09:12 INFO ql.Driver: Query ID = hive_20151124140909_e8cbb9bd-bac0-40b2-83d0-382de25b80d1
> 15/11/24 14:09:12 INFO ql.Driver: Total jobs = 1
> ...
> 15/11/24 14:09:40 INFO ql.Driver: MapReduce Jobs Launched:
> 15/11/24 14:09:40 INFO ql.Driver: Stage-Stage-1: Map: 1  Reduce: 1   Cumulative CPU:
3.58 sec   HDFS Read: 52956 HDFS Write: 4 SUCCESS
> 15/11/24 14:09:40 INFO ql.Driver: Total MapReduce CPU Time Spent: 3 seconds 580 msec
> 15/11/24 14:09:40 INFO ql.Driver: OK
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message