hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kristoffer Sjögren <sto...@gmail.com>
Subject Re: Timerange scan
Date Tue, 03 Mar 2015 08:52:18 GMT
What can I say? Awesome community! :-)

On Mon, Mar 2, 2015 at 11:17 PM, Gary Helmling <ghelmling@gmail.com> wrote:

> Proving it to yourself is sometimes the hardest part!
>
> On Mon, Mar 2, 2015 at 2:11 PM Nick Dimiduk <ndimiduk@gmail.com> wrote:
>
> > Gary to the rescue! Does it still count as being right even if you cannot
> > prove it for yourself? ;)
> >
> > On Mon, Mar 2, 2015 at 2:06 PM, Gary Helmling <ghelmling@gmail.com>
> wrote:
> >
> > > >
> > > > Sorry Kristoffer, but I believe my previous statement was mistaken. I
> > > > cannot find a location where the timestamp is taken into account at
> the
> > > > StoreFile level. I thought the above statement about metadata from
> the
> > > > HFile headers was correct, but I cannot locate the code that takes
> such
> > > > information into consideration.
> > > >
> > >
> > > I believe the filtering happens in StoreScanner.selectScannersFrom(),
> > which
> > > calls StoreFileScanner.shouldUseScanner() for each store file.  See
> also
> > > StoreFile.passesTimerangeFilter(), which does the check that the Scan's
> > > time range is included in the time range from the store file metadata.
> > >
> > > So store files which fall completely outside of the Scan's min/max
> > > timestamps should be excluded.
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message