hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <>
Subject [jira] [Commented] (HIVE-933) Infer bucketing/sorting properties
Date Mon, 29 Oct 2012 11:29:12 GMT


Namit Jain commented on HIVE-933:

For bucketing/sorting properties, partition based metadata is used now. So, inferring these
properties should help in better plans for downstream queries.
> Infer bucketing/sorting properties
> ----------------------------------
>                 Key: HIVE-933
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Kevin Wilfong
> This is a long-term plan, and may require major changes.
> From the query, we can figure out the sorting/bucketing properties, and change the metadata
of the destination at that time.
> However, this means that different partitions may have different metadata. Currently,
the query plan is same for all the 
> partitions of the table - we can do the following:
> 1. In the first cut, have a simple approach where you take the union all metadata, and
create the most defensive plan.
> 2. Enhance mapredWork() to include partition specific operator trees.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message