hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Wilfong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2453) Need a way to categorize queries in hooks for improved logging
Date Fri, 16 Sep 2011 22:47:08 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106889#comment-13106889
] 

Kevin Wilfong commented on HIVE-2453:
-------------------------------------

I'm abandoning this change.

In order to determine if a script is used in the mapper or reducer, I believe I would need
to go through all the Map Reduce tasks' operators looking for Transform operators.  That's
more work than I would like to perform for a feature which most users probably won't use,
so I would add that to a hook.  As long as I have to do that work in a hook in order to get
that classification, I can get the other categorizations with minimal additional effort.

> Need a way to categorize queries in hooks for improved logging
> --------------------------------------------------------------
>
>                 Key: HIVE-2453
>                 URL: https://issues.apache.org/jira/browse/HIVE-2453
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>         Attachments: HIVE-2453.1.patch.txt
>
>
> We need a way to categorize queries, such as whether or not the include a join clause,
a group by clause, etc., in the hooks.  This will allow for better performance logging.
> Currently the only way I can find is to go through the operators in the tasks, but which
operators are used for the different types of queries may change over time.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message