hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5831) filter input files for bucketed tables
Date Fri, 15 Nov 2013 07:39:21 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rui Li updated HIVE-5831:
-------------------------

    Attachment: hive-5831.patch

This implementation supports filtering bucketed table with single bucket key. The bucket key
can be of type int or string. And it supports "=", "IN" and "BETWEEN AND" operators as the
predicate.
Set hive.optimize.bucket.filter to true to enable this feature.

> filter input files for bucketed tables
> --------------------------------------
>
>                 Key: HIVE-5831
>                 URL: https://issues.apache.org/jira/browse/HIVE-5831
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Rui Li
>         Attachments: hive-5831.patch
>
>
> When the users query a bucketed table and use the bucketed column in the predicate, only
the buckets that satisfy the predicate need to be scanned, thus improving the performance.
> Given a table test:
> CREATE TABLE test (x INT, y STRING) CLUSTERED BY ( x ) INTO 10 BUCKETS;
> The following query only has to scan bucket 5:
> SELECT * FROM test WHERE x=5;



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message