hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Created: (HIVE-933) Infer bucketing/sorting properties
Date Fri, 13 Nov 2009 20:38:39 GMT
Infer bucketing/sorting properties
----------------------------------

                 Key: HIVE-933
                 URL: https://issues.apache.org/jira/browse/HIVE-933
             Project: Hadoop Hive
          Issue Type: New Feature
          Components: Query Processor
            Reporter: Namit Jain
             Fix For: 0.5.0


This is a long-term plan, and may require major changes.

>From the query, we can figure out the sorting/bucketing properties, and change the metadata
of the destination at that time.
However, this means that different partitions may have different metadata. Currently, the
query plan is same for all the 
partitions of the table - we can do the following:

1. In the first cut, have a simple approach where you take the union all metadata, and create
the most defensive plan.
2. Enhance mapredWork() to include partition specific operator trees.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message