hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasad Chakka (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-463) Add a pre execution hook to ql
Date Sun, 03 May 2009 00:23:30 GMT

    [ https://issues.apache.org/jira/browse/HIVE-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12705353#action_12705353
] 

Prasad Chakka commented on HIVE-463:
------------------------------------

- can you include ql/test/classes through a build variable so that for metastore and cli,
this will not get included?
- add param hive.exec.pre.hooks to the hive-default.xml
- i think it better for getPreExecuteHooks() to through ClassNotFoundException and put a proper
error message in the Driver.execute() otherwise it would be baffling for users what this class
and why it is not found
- in WriteEntity, is there a need to distinguish between local and dfs? As Joydeep pointed
out, the file could be on some other file system (such as s3n). I think WriteEntity.d should
be a URI or a string representation of URI and let the PreExecute script figure it out what
it is.
- equals() of Read and Write entities should check for NULLs.
- is there a specific reason for input and output maps be LinkedHashSet?
- can you include a negative testcase for non-existent preexecutehook class 



> Add a pre execution hook to ql
> ------------------------------
>
>                 Key: HIVE-463
>                 URL: https://issues.apache.org/jira/browse/HIVE-463
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Query Processor
>    Affects Versions: 0.4.0
>            Reporter: Ashish Thusoo
>            Assignee: Ashish Thusoo
>            Priority: Minor
>         Attachments: patch-463.txt
>
>
> There may be cases where user defined logic needs to be executed between the compilation
and execution phases of a query. One simple example that we ran into is based on archival.
If an external utility archives table partitions of example, then a plugin logic can check
that for the partitions and take suitable action such as:
> - Unarchiving the partition seemlessly
> - Throwing an error
> etc..
> This same framework can also be used for updating query compilation stats.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message