hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <>
Subject [jira] Updated: (HIVE-1546) Ability to plug custom Semantic Analyzers for Hive Grammar
Date Thu, 09 Sep 2010 21:13:33 GMT


Ashutosh Chauhan updated HIVE-1546:

    Attachment: Howl_Semantic_Analysis.txt

As far as I understand, Hooks were designed to run before or after the query executes, not
while query is getting executing. By executing a query I mean (generating AST, doing semantic
analysis of that AST which includes necessary metadata operations, building a query plan and
running the plan). If that was how hook were intended to be used I am not clear how they will
be used in this scenario. In Howl its not just a list of metadata operations that we want
to allow or disallow, there is a bit more semantic analysis that we do which includes doing
metadata operation on metadata repository. Its not really before or after query is executed,
it is one of the parts of query processing itself. You also hinted that hooks can be modified
and more information can be provided in those methods. If thats what we do then I think we
are loosing semantics on hooks which is something which is fired before and after the query
executes, as hook will now be running while query is executing. Its entirely possible that
I have misunderstood hooks and their intended usage. You obviously know more then so feel
free to correct me. 
I am also attaching what semantic analysis that we are doing for everyone's reference for
better context.

> Ability to plug custom Semantic Analyzers for Hive Grammar
> ----------------------------------------------------------
>                 Key: HIVE-1546
>                 URL:
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.7.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.7.0
>         Attachments: hive-1546-3.patch, hive-1546-4.patch, hive-1546.patch, hive-1546_2.patch,
> It will be useful if Semantic Analysis phase is made pluggable such that other projects
can do custom analysis of hive queries before doing metastore operations on them. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message