Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 02C751890C for ; Sat, 14 Nov 2015 07:41:12 +0000 (UTC) Received: (qmail 98768 invoked by uid 500); 14 Nov 2015 07:41:11 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 98717 invoked by uid 500); 14 Nov 2015 07:41:11 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 98650 invoked by uid 99); 14 Nov 2015 07:41:11 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 14 Nov 2015 07:41:11 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 4DE2B2C1F75 for ; Sat, 14 Nov 2015 07:41:11 +0000 (UTC) Date: Sat, 14 Nov 2015 07:41:11 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-14355) Scan different TimeRange for each column family MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005235#comment-15005235 ] Hudson commented on HBASE-14355: -------------------------------- SUCCESS: Integrated in HBase-1.2-IT #281 (See [https://builds.apache.org/job/HBase-1.2-IT/281/]) HBASE-14355 Scan different TimeRange for each column family (stack: rev 76187d116110c0d67d3a9b73c9e5c25cdfea5ea6) * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultMemStore.java * hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/NonLazyKeyValueScanner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/KeyValueScanner.java * hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileWriterV2.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/Query.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java * hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFile.java * hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/HBaseProtos.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileScanner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java * hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompoundBloomFilter.java * hbase-protocol/src/main/protobuf/HBase.proto * hbase-protocol/src/main/protobuf/Client.proto > Scan different TimeRange for each column family > ----------------------------------------------- > > Key: HBASE-14355 > URL: https://issues.apache.org/jira/browse/HBASE-14355 > Project: HBase > Issue Type: New Feature > Components: Client, regionserver, Scanners > Reporter: Dave Latham > Assignee: churro morales > Fix For: 2.0.0, 1.3.0, 0.98.17 > > Attachments: HBASE-14355-v1.patch, HBASE-14355-v10.patch, HBASE-14355-v11.patch, HBASE-14355-v2.patch, HBASE-14355-v3.patch, HBASE-14355-v4.patch, HBASE-14355-v5.patch, HBASE-14355-v6.patch, HBASE-14355-v7.patch, HBASE-14355-v8.patch, HBASE-14355-v9.patch, HBASE-14355.branch-1.patch, HBASE-14355.patch > > > At present the Scan API supports only table level time range. We have specific use cases that will benefit from per column family time range. (See background discussion at https://mail-archives.apache.org/mod_mbox/hbase-user/201508.mbox/%3CCAA4mzom00ef5eoXStK0HEtxebY8mQSs61GBVGttgpASpmhQHaw@mail.gmail.com%3E) > There are a couple of choices that would be good to validate. First - how to update the Scan API to support family and table level updates. One proposal would be to add Scan.setTimeRange(byte family, long minTime, long maxTime), then store it in a Map. When executing the scan, if a family has a specified TimeRange, then use it, otherwise fall back to using the table level TimeRange. Clients using the new API against old region servers would not get the families correctly filterd. Old clients sending scans to new region servers would work correctly. > The other question is how to get StoreFileScanner.shouldUseScanner to match up the proper family and time range. It has the Scan available but doesn't currently have available which family it is a part of. One option would be to try to pass down the column family in each constructor path. Another would be to instead alter shouldUseScanner to pass down the specific TimeRange to use (similar to how it currently passes down the columns to use which also appears to be a workaround for not having the family available). -- This message was sent by Atlassian JIRA (v6.3.4#6332)