hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Thusoo (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-463) Add a pre execution hook to ql
Date Mon, 04 May 2009 21:07:30 GMT

    [ https://issues.apache.org/jira/browse/HIVE-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12705744#action_12705744
] 

Ashish Thusoo commented on HIVE-463:
------------------------------------

Also the change for dfs and non dfs files is much more involved. We make the dfs and local
assumption thoughout the ql layer and we really do not maintain those as URLs. The local and
dfs flag is set depending upon whether we are doing

INSERT OVERWRITE DIRECTORY

or 

INSERT OVERWRITE LOCAL DIRECTORY.

We will have to fix that semantics and language constructs before we can address this more
holistically. I suggest we file a separate JIRA for that.


> Add a pre execution hook to ql
> ------------------------------
>
>                 Key: HIVE-463
>                 URL: https://issues.apache.org/jira/browse/HIVE-463
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Query Processor
>    Affects Versions: 0.4.0
>            Reporter: Ashish Thusoo
>            Assignee: Ashish Thusoo
>            Priority: Minor
>         Attachments: patch-463.txt, patch-463_2.txt
>
>
> There may be cases where user defined logic needs to be executed between the compilation
and execution phases of a query. One simple example that we ran into is based on archival.
If an external utility archives table partitions of example, then a plugin logic can check
that for the partitions and take suitable action such as:
> - Unarchiving the partition seemlessly
> - Throwing an error
> etc..
> This same framework can also be used for updating query compilation stats.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message