Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Fri, 15 Nov 2013 07:39:21 +0000 (UTC)
From: "Rui Li (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12679346.1384500685069.79452.1384501161014@arcas>
In-Reply-To: <JIRA.12679346.1384500685069@arcas>
References: <JIRA.12679346.1384500685069@arcas>
Subject: [jira] [Updated] (HIVE-5831) filter input files for bucketed tables
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HIVE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rui Li updated HIVE-5831:
-------------------------

    Attachment: hive-5831.patch

This implementation supports filtering bucketed table with single bucket key. The bucket key can be of type int or string. And it supports "=", "IN" and "BETWEEN AND" operators as the predicate.
Set hive.optimize.bucket.filter to true to enable this feature.

> filter input files for bucketed tables
> --------------------------------------
>
>                 Key: HIVE-5831
>                 URL: https://issues.apache.org/jira/browse/HIVE-5831
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Rui Li
>         Attachments: hive-5831.patch
>
>
> When the users query a bucketed table and use the bucketed column in the predicate, only the buckets that satisfy the predicate need to be scanned, thus improving the performance.
> Given a table test:
> CREATE TABLE test (x INT, y STRING) CLUSTERED BY ( x ) INTO 10 BUCKETS;
> The following query only has to scan bucket 5:
> SELECT * FROM test WHERE x=5;


--
This message was sent by Atlassian JIRA
(v6.1#6144)