hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carl Steinbach (JIRA)" <>
Subject [jira] [Updated] (HIVE-2535) Use sorted nature of compact indexes
Date Wed, 27 Jun 2012 22:10:44 GMT


Carl Steinbach updated HIVE-2535:

    Component/s: Query Processor
         Labels: indexing performance  (was: )
> Use sorted nature of compact indexes
> ------------------------------------
>                 Key: HIVE-2535
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Indexing, Query Processor
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>              Labels: indexing, performance
>             Fix For: 0.8.0
>         Attachments: HIVE-2535.1.patch.txt, HIVE-2535.2.patch.txt, HIVE-2535.3.patch.txt,
> Compact indexes are sorted based on the indexed columns, but we are not using this fact
when we access the index.
> To start with, if the index is stored as an RC file, and if the predicate being used
to access the index consists of only one non-partition condition using one of the operators
>,>=,<,<=,= we could use a binary search (if necessary) to find the block to begin
scanning for unfiltered rows, and we could use the result of comparing the value in the column
with the constant (this is necessarily the form of a predicate which is optimized using an
index) to determine when we have found all the rows which will be unfiltered.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message