hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Wilfong (JIRA)" <>
Subject [jira] [Commented] (HIVE-2453) Need a way to categorize queries in hooks for improved logging
Date Fri, 16 Sep 2011 22:47:08 GMT


Kevin Wilfong commented on HIVE-2453:

I'm abandoning this change.

In order to determine if a script is used in the mapper or reducer, I believe I would need
to go through all the Map Reduce tasks' operators looking for Transform operators.  That's
more work than I would like to perform for a feature which most users probably won't use,
so I would add that to a hook.  As long as I have to do that work in a hook in order to get
that classification, I can get the other categorizations with minimal additional effort.

> Need a way to categorize queries in hooks for improved logging
> --------------------------------------------------------------
>                 Key: HIVE-2453
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>         Attachments: HIVE-2453.1.patch.txt
> We need a way to categorize queries, such as whether or not the include a join clause,
a group by clause, etc., in the hooks.  This will allow for better performance logging.
> Currently the only way I can find is to go through the operators in the tasks, but which
operators are used for the different types of queries may change over time.

This message is automatically generated by JIRA.
For more information on JIRA, see:


View raw message