Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com
 designates 209.85.214.45 as permitted sender)
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: 
 <CAKxWWm0SUq389nZrpLZgVq0kYoMc9QeYxiy3XEi0o25as2mz9A@mail.gmail.com>
References: 
 <CAKxWWm3MnQhVgKuN52taaZ-XUVe82jFNpKB7WE-k4es6bsm-2Q@mail.gmail.com>
	<CAKxWWm0STgc1jTeXozw6+Pm7Y9GdsaqnhZ0S1VUSPC+w4hG5bw@mail.gmail.com>
	<CADcMMgFprWL3eVsH0SDHy-mhA6o+cqqMYSyeEo5gASA3dKzYWw@mail.gmail.com>
	<CADcMMgEojdn94zo0ZUyvtWxabLuZxj1DpnBzm5T2qqK+9ucgng@mail.gmail.com>
	<CAKxWWm0SUq389nZrpLZgVq0kYoMc9QeYxiy3XEi0o25as2mz9A@mail.gmail.com>
Date: Thu, 16 May 2013 14:50:36 -0700
Message-ID: 
 <CADcMMgFsHRv06y9YV9ZjC3viVorHB2EnNOr1y2wwWrM7UmM7Xw@mail.gmail.com>
Subject: Re: Question about HFile seeking
From: Stack <stack@duboce.net>
To: Hbase-User <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=14dae94733dd4e209c04dcdcdb8d

--14dae94733dd4e209c04dcdcdb8d
Content-Type: text/plain; charset=UTF-8

What is your query?

If scanning over rows of 100k, yeah, you will go through each row's content
unless you specify you are only interested in some subset of the rows.
 Then a 'skipping' facility will cut where we will use the index to skip
over unwanted content.

St.Ack


On Thu, May 16, 2013 at 2:42 PM, Varun Sharma <varun@pinterest.com> wrote:

> Nothing, I am just curious...
>
> So, we will do a bunch of wasteful scanning - that's lets say row1 has col1
> - col100000 - basically 100K columns, we will scan all those key values
> even though we are going to discard them, is that correct ?
>
>
> On Thu, May 16, 2013 at 2:30 PM, Stack <stack@duboce.net> wrote:
>
> > What you seeing Varun (or think you are seeing)?
> > St.Ack
> >
> >
> > On Thu, May 16, 2013 at 2:30 PM, Stack <stack@duboce.net> wrote:
> >
> > > On Thu, May 16, 2013 at 2:03 PM, Varun Sharma <varun@pinterest.com>
> > wrote:
> > >
> > >> Or do we use some kind of demarcator b/w rows and columns and
> timestamps
> > >> when building the HFile keys and the indices ?
> > >>
> > >
> > > No demarcation but in KeyValue, we keep row, column family name, column
> > > family qualifier, etc., lengths and offsets so the comparators on ly
> > > compare pertinent bytes.
> > >
> > > If you doing a prefix scan w/ row1c, we should be starting the scan at
> > > row1c, not row1 (or more correctly at the row that starts the block we
> > > believe has a row1c row in it...).
> > >
> > > St.Ack
> > >
> >
>

--14dae94733dd4e209c04dcdcdb8d--