hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lianhui Wang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-3329) Support bucket filtering when where expression or join key expression has the bucket key
Date Thu, 02 Aug 2012 05:44:02 GMT
Lianhui Wang created HIVE-3329:
----------------------------------

             Summary: Support bucket filtering when where expression or join key expression
has the bucket key 
                 Key: HIVE-3329
                 URL: https://issues.apache.org/jira/browse/HIVE-3329
             Project: Hive
          Issue Type: New Feature
          Components: Query Processor
            Reporter: Lianhui Wang


in HIVE-3306, it introduces a context.
example:
select /* + MAPJOIN(a) */ count FROM bucket_small a JOIN bucket_big b ON a.key + a.key = b.key
also there are some other contexts.i know the following example:
1. join expression is ON (a.key = b.key and a.key=10);
2. select * from bucket_small where a.key=10;
3. 
the table is a partition table,that maybe complex.
example:
CREATE TABLE srcbucket_part (key string, value string) partitioned by (ds string) CLUSTERED
BY (key) INTO 4 BUCKETS STORED AS RCFile;
select * from srcbucket_part where key='455' and ds='2008-04-08';
maybe complex sql is:
select * from srcbucket_part where (key='455' and ds='2008-04-08') or  ds='2008-04-09';
these contexts should not scan full table's files and only scan the some bucket files in the
table path.




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message