hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-12558) LLAP: output QueryFragmentCounters somewhere
Date Tue, 01 Dec 2015 22:37:11 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034756#comment-15034756
] 

Sergey Shelukhin edited comment on HIVE-12558 at 12/1/15 10:36 PM:
-------------------------------------------------------------------

Summary in Tez print-out would be nice, perhaps it should be grouped by tables. However, it
should also be easy to view metrics for past queries. AFAIK (judging by some JIRA I saw) Web
UI only shows very recent queries. 


was (Author: sershe):
Summary in Tez counters would be nice, perhaps it should be grouped by tables. However, it
should also be easy to view metrics for past queries. AFAIK (judging by some JIRA I saw) Web
UI only shows very recent queries. 

> LLAP: output QueryFragmentCounters somewhere
> --------------------------------------------
>
>                 Key: HIVE-12558
>                 URL: https://issues.apache.org/jira/browse/HIVE-12558
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>            Reporter: Sergey Shelukhin
>            Assignee: Prasanth Jayachandran
>
> Right now, LLAP logs counters for every fragment; most of them are IO related and could
be very useful, they also include table names so that things like cache hit ratio, etc., could
be calculated for every table.
> We need to output them to some metrics system (preserving the breakdown by table, possibly
also adding query ID or even stage) so that they'd be usable without grep/sed/awk.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message