Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of ablimit@gmail.com designates
 209.85.214.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAKMbcXJmi++8k_Yj+wB5iUzJKAfDd+yvbE+pS-rD5m3OpCOaxw@mail.gmail.com>
References: 
 <CAFXCZqxBT74U+03s0HjdNArWjNzV982Cf61y4rLMEtf3-uQsYA@mail.gmail.com>
	<CAKMbcXJmi++8k_Yj+wB5iUzJKAfDd+yvbE+pS-rD5m3OpCOaxw@mail.gmail.com>
Date: Thu, 16 Aug 2012 12:43:20 -0400
Message-ID: 
 <CAFXCZqyUmAv8UvU5mNeAYzGzhS=1NwTdOjA4rEFa1zsh83EdBA@mail.gmail.com>
Subject: Re: Problem with Hive Indexing
From: Ablimit Aji <ablimit@gmail.com>
To: dev@hive.apache.org
Content-Type: multipart/alternative; boundary=f46d044786e7b82f2004c764bd9c

--f46d044786e7b82f2004c764bd9c
Content-Type: text/plain; charset=UTF-8

Thanks Mahsa !
I didn't know that there is such a constraint.

Best,
Ablimit

On Thu, Aug 16, 2012 at 12:32 PM, Mahsa Mofidpoor <mofidpoor@gmail.com>wrote:

> Hi,
>
> At lease the table size must be greater than 5GB to use the index for
> filter pushdown. Otherwise you have to comment the checkQuerySize method.
>
> Cheers,
> Mahsa
>
> On Mon, Jul 30, 2012 at 11:12 AM, Ablimit Aji <ablimit@gmail.com> wrote:
>
> > I have written a custom index handler and wanted to test it. However hive
> > is not using it.
> > So I test with simple table (pokes (int foo, string bar)) which comes
> with
> > hive distribution for testing purpose.
> > Then I created a compact index and set the set
> > hive.optimize.index.filter=true;
> > However, upon checking the log info, it seems hive is still not using the
> > index.
> > So, what is the problem ?
> > The query I issued is as follow:  select foo from pokes WHERE foo=498 ;
> >
> > Below is the log info I got after issuing the query.
> >
> > 12/07/26 12:25:17 INFO index.IndexWhereProcessor: Processing predicate
> for
> > index optimization
> > 12/07/26 12:25:17 INFO index.IndexWhereProcessor: (foo = 498)
> > 12/07/26 12:25:17 INFO metastore.HiveMetaStore: 0: get_table : db=default
> > tbl=pokes_idx
> > 12/07/26 12:25:17 INFO hive.log: DDL: struct pokes_idx { i32 foo, string
> > _bucketname, list _offsets}
> > 12/07/26 12:25:17 INFO index.IndexWhereProcessor: checking index
> > staleness...
> > 12/07/26 12:25:17 INFO index.IndexWhereProcessor: 1342465077455
> > 12/07/26 12:25:17 INFO index.IndexWhereProcessor: 1342465077455
> > 12/07/26 12:25:17 INFO util.NativeCodeLoader: Loaded the native-hadoop
> > library
> > 12/07/26 12:25:17 WARN snappy.LoadSnappy: Snappy native library not
> loaded
> >
>

--f46d044786e7b82f2004c764bd9c--