hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-478) Surface "processor time" for queries
Date Wed, 06 Jan 2010 16:25:54 GMT

    [ https://issues.apache.org/jira/browse/HIVE-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797164#action_12797164
] 

Namit Jain commented on HIVE-478:
---------------------------------

Can you set the configuration parameter hive.task.progress to true. It will dump the total
time taken by each operator.
Please check if this meets your requirements, we can enhance it to add more stuff.

> Surface "processor time" for queries
> ------------------------------------
>
>                 Key: HIVE-478
>                 URL: https://issues.apache.org/jira/browse/HIVE-478
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Logging, Query Processor
>            Reporter: Adam Kramer
>
> We currently list real-time metrics of how long queries take--"finished in: 1min 13sec"
appears on the job tracker. However, this is affected by a lot more than just the quality
or implementation of the query. For example, number of mappers used varies a lot when you
use subqueries versus single-query aggregation, as does the amount of work necessary.
> For implementation comparisons (e.g., "should I use this version of the query or that
one"), ti would be great to know the processor time used instead of the real time used...both
in terms of "mapper cpu seconds" and "reducer cpu seconds."

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message