Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D9FFC10808 for ; Tue, 3 Mar 2015 08:55:16 +0000 (UTC) Received: (qmail 86665 invoked by uid 500); 3 Mar 2015 08:55:01 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 86580 invoked by uid 500); 3 Mar 2015 08:55:01 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 86489 invoked by uid 99); 3 Mar 2015 08:55:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2015 08:55:00 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of stoffe@gmail.com designates 209.85.220.45 as permitted sender) Received: from [209.85.220.45] (HELO mail-pa0-f45.google.com) (209.85.220.45) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2015 08:54:55 +0000 Received: by paceu11 with SMTP id eu11so8302042pac.1 for ; Tue, 03 Mar 2015 00:52:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=MWKIqS2zgLox0h2+OysUySjIXChunlxgo4dcqqd188Y=; b=LiiixbItDcKewUxiFlNHUiO5hP3ity/xEdPVB3DuXvshu660R7yhfgsNi12f0icMzK tJZ9Woy535KOBBnBrREdyT8+qTdW6RaMYjFNqsg9GBhbJb1nZZ331mInMop+HUmsm1HN H4ch2mferVCxKz9vgyb7to3QyLMXaclcLdflr/FMvFnPY+LaFRZyK9HIjgRLHqflidZK VsBEf/1oVdtqNzQy/74Z1Q/U4J5zBKHtkxstnl699+CIRO1aovGNdPQltgBCGR445EzO 9RM5iM7JRtT+5NkF5zWKUC9E4if9x6Bb23kH2S/KaBNxuiK/OI036TTlmETMZKicLJxG /fRg== MIME-Version: 1.0 X-Received: by 10.70.89.231 with SMTP id br7mr3046117pdb.116.1425372738949; Tue, 03 Mar 2015 00:52:18 -0800 (PST) Received: by 10.66.149.130 with HTTP; Tue, 3 Mar 2015 00:52:18 -0800 (PST) In-Reply-To: References: Date: Tue, 3 Mar 2015 09:52:18 +0100 Message-ID: Subject: Re: Timerange scan From: =?UTF-8?Q?Kristoffer_Sj=C3=B6gren?= To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a11c22ca4c7185e05105e7386 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c22ca4c7185e05105e7386 Content-Type: text/plain; charset=UTF-8 What can I say? Awesome community! :-) On Mon, Mar 2, 2015 at 11:17 PM, Gary Helmling wrote: > Proving it to yourself is sometimes the hardest part! > > On Mon, Mar 2, 2015 at 2:11 PM Nick Dimiduk wrote: > > > Gary to the rescue! Does it still count as being right even if you cannot > > prove it for yourself? ;) > > > > On Mon, Mar 2, 2015 at 2:06 PM, Gary Helmling > wrote: > > > > > > > > > > Sorry Kristoffer, but I believe my previous statement was mistaken. I > > > > cannot find a location where the timestamp is taken into account at > the > > > > StoreFile level. I thought the above statement about metadata from > the > > > > HFile headers was correct, but I cannot locate the code that takes > such > > > > information into consideration. > > > > > > > > > > I believe the filtering happens in StoreScanner.selectScannersFrom(), > > which > > > calls StoreFileScanner.shouldUseScanner() for each store file. See > also > > > StoreFile.passesTimerangeFilter(), which does the check that the Scan's > > > time range is included in the time range from the store file metadata. > > > > > > So store files which fall completely outside of the Scan's min/max > > > timestamps should be excluded. > > > > > > --001a11c22ca4c7185e05105e7386--