hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1781) outputs not populated for dynamic partitions at compile time
Date Thu, 11 Nov 2010 19:45:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12931162#action_12931162
] 

He Yongqiang commented on HIVE-1781:
------------------------------------

+1 running tests.

> outputs not populated for dynamic partitions at compile time
> ------------------------------------------------------------
>
>                 Key: HIVE-1781
>                 URL: https://issues.apache.org/jira/browse/HIVE-1781
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1781.1.patch
>
>
> OSTHOOK: query: create table tstsrcpart like srcpart
> POSTHOOK: type: CREATETABLE
> POSTHOOK: Output: default@tstsrcpart
> PREHOOK: query: from srcpart
> insert overwrite table tstsrcpart partition (ds, hr) select key, value, ds, hr where
ds <= '2008-04-08'
> PREHOOK: type: QUERY
> PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
> PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
> POSTHOOK: query: from srcpart
> As is evident from above, the outputs are not populated at all at compile time.
> This may create a problem for many components that depend on outputs: locking, authorization
etc.
> However, the exact set of outputs may be needed for some other components (for example.
the
> internal deployment in Facebook has a replication hook which is used for replication
which needs the
> exact set of outputs). It may  be a good idea to extend WriteEntity to include a flag
which indicates
> whether the output is complete or not, and then the hook can look at that flag if needed

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message