hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Sichi <>
Subject Re: Indexing
Date Mon, 10 Oct 2011 22:36:01 GMT
Hi Avrilia,

These are (some of) the patches you are looking for:


I'm not sure what went into 0.7.1 but they will all be in the upcoming 0.8 release.

JIRA is your friend:

Now that so much work has been contributed in this area, it would be awesome if someone could
take on HIVE-1502 (doc updates).


On Oct 7, 2011, at 11:30 AM, Avrilia Floratou wrote:

> Hi,
> I'd like to know what's the current status of indexing in hive. What I've
> found so far is that the user has to manually set the index table for each
> query. Sth like this:
> ******************************************************
> insert overwrite directory "/tmp/index_result" select `_bucketname` ,
> `_offsets` from src_rc_index where key=0;
> set hive.exec.index_file=/tmp/index_result;
> //use a new index file format to prune inputsplit based on the offset list
> //stored in "hive.exec.index_file" which is populated in previous command
> set
> //this query will not scan the whole base data
> select key, value from src_rc where key=0;
> *******************************************************
> Is there any automatic plan generation that can make use of the existing
> indices in the 0.7.1 release or any patch available that can do that?
> Thanks,
> Avrilia

View raw message