hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Sichi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1079) CREATE VIEW followup: derive dependencies on underlying base table partitions from view definition
Date Tue, 15 Jun 2010 23:11:25 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879169#action_12879169
] 

John Sichi commented on HIVE-1079:
----------------------------------

For the manual approach, a very simple thing we can start with is just letting users add partitions
to views explicitly as a way of indicating that the underlying data is ready.

> CREATE VIEW followup:  derive dependencies on underlying base table partitions from view
definition
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1079
>                 URL: https://issues.apache.org/jira/browse/HIVE-1079
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.6.0
>            Reporter: John Sichi
>            Assignee: John Sichi
>             Fix For: 0.6.0
>
>
> When querying a view, it would be useful to know which underlying base table partitions
it depends on in order to know how fresh the result is (or to be able to wait until all of
those partitions have been loaded consistently).  The task is to come up with a way to perform
this analysis automatically (possibly overconservatively), or alternately to let the view
creator annotate the view definition with this dependency information, or some combination
of the two.
> Note that this would be useful for any complex query which directly accesses base tables
(not just view definitions).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message