Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 58F14F74A for ; Fri, 22 Mar 2013 04:19:54 +0000 (UTC) Received: (qmail 64751 invoked by uid 500); 22 Mar 2013 04:19:52 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 64587 invoked by uid 500); 22 Mar 2013 04:19:52 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 64577 invoked by uid 99); 22 Mar 2013 04:19:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Mar 2013 04:19:51 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.139.212.163] (HELO nm4.bullet.mail.bf1.yahoo.com) (98.139.212.163) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 22 Mar 2013 04:19:44 +0000 Received: from [98.139.212.150] by nm4.bullet.mail.bf1.yahoo.com with NNFMP; 22 Mar 2013 04:19:23 -0000 Received: from [98.139.212.195] by tm7.bullet.mail.bf1.yahoo.com with NNFMP; 22 Mar 2013 04:19:23 -0000 Received: from [127.0.0.1] by omp1004.mail.bf1.yahoo.com with NNFMP; 22 Mar 2013 04:19:23 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 446843.57123.bm@omp1004.mail.bf1.yahoo.com Received: (qmail 79185 invoked by uid 60001); 22 Mar 2013 04:19:23 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1363925963; bh=SMQnjoCIYRlUbfjN4iC1fj2ZTLYWqCjv1eL1Y/JDxMI=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=IC3pfRDbj3MnZohYjKDSfb3XaamAGWwU2aQsUOqTTaNvUHjMMp334XxnwjQ2Kh3LDLbbFbEnIAINkODE/KkG8ODRWo/eAYZqd4JwMBwsFLAFVal6b3MFhcnkZl6/7HcQH/Dk0aaEKReso4ZjcACSunJ4u9XwpV/m/zLGnXsMsO8= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=fpSM0yOn2zlXmIqEnWHSpXj3hgfv0TExJG5vBgZkls4dArgS6Y4DMTd0nK8ZEka1b6A6xVyX18Y1xew6EBRS+uzuKFGAFKoH58QhY5BNW4SHtnRMu+W3fcBswN3uZhdLOMPHBG2SWCstbwI93gCG9EDfIYPLxNy0gHoxCFRmdwM=; X-YMail-OSG: 9yDNjacVM1m.Vx4wLMPLH.AU_C.zLDG6UPraXTHPaK9Ff.J 0C24lGG9zri6vwaanQimkybZtLmJDjYvKoiL35J9GHqtHcsCcM2umknpFYbH Ct1xdW7CwXxSLkMrML33mdBp5MRUPZGP5QncmVw_cDUBm7CwbmgtRaPcC9zs 0dh0VrlyCj_9t31DaucOwemtDTEmCpO8yrHoimtYbHkAlJqfi4KGWsXVKZUO l9HYvpTsHIU5.q25h9xnyb_PHDcp9GvLOeQWrJQuLg.vEJuxKAlf6E7pr5Fg tMEeH9b2KLGoZSeECrnWzTj3EDbl8uSZV3bElchd.EGq4bh6vTUmfsbRDFYR zh9Oy4uYxYog.MtjaWxCGt3stOFvP_McECQN9ET1VLyQf6seY949eStImTkU SVXv8F_6XHli_ucMMkleCuwb_NWyNFOc8SQCECc9ND4193gXt4HKIh.gnqgo 23pKuuXRgcSI8YKyk.SGTZ8X0vV962dAIqX_VRZmQ.PaXkpqd6W9HvesUfVC 1ETWTQaMG78dO82R3JvY- Received: from [24.130.114.129] by web140601.mail.bf1.yahoo.com via HTTP; Thu, 21 Mar 2013 21:19:23 PDT X-Rocket-MIMEInfo: 002.001,V2Ugc2hvdWxkIHRhbGsuCgpJZiB5b3UgY2FuIGVudmlzaW9uIGFuIGludGVyZmFjZSB0aGF0IGlzIGZhc3RlciwgbWF5YmUgd2UgY2FuIHByb3ZpZGUgdGhlIHJpZ2h0IHNob3J0Y3V0IG9yIGNoYW5nZSB0aGluZ3MgYXJvdW5kIGluIHRoZSBjbGllbnQgdG8gYWNjZXNzIHRoZSBkYXRhIGF0IHRoZSByaWdodCBzdGFnZSBvciBmb3JtYXQuCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KIEZyb206IFNuYWtlIDx5ZndhbmdAeGluZ2Nsb3VkLmNvbT4KVG86IHVzZXJAaGJhc2UuYXBhY2hlLm9yZyABMAEBAQE- X-RocketYMMF: lhofhansl X-Mailer: YahooMailWebService/0.8.138.524 References: <0CE69E9126D0344088798A3B7F7F80863AEE79D8@SZXEML553-MBX.china.huawei.com> <55394E95-F4E8-438E-BD30-B047881D965C@xingcloud.com> Message-ID: <1363925963.78761.YahooMailNeo@web140601.mail.bf1.yahoo.com> Date: Thu, 21 Mar 2013 21:19:23 -0700 (PDT) From: lars hofhansl Reply-To: lars hofhansl Subject: Re: Is there a way to only scan data in memstore To: "user@hbase.apache.org" In-Reply-To: <55394E95-F4E8-438E-BD30-B047881D965C@xingcloud.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="969045052-2020399676-1363925963=:78761" X-Virus-Checked: Checked by ClamAV on apache.org --969045052-2020399676-1363925963=:78761 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable We should talk.=0A=0AIf you can envision an interface that is faster, maybe= we can provide the right shortcut or change things around in the client to= access the data at the right stage or format.=0A=0A=0A____________________= ____________=0A From: Snake =0ATo: user@hbase.apache.= org =0ASent: Thursday, March 21, 2013 2:44 AM=0ASubject: Re: Is there a way= to only scan data in memstore=0A =0AWe are attempting to implement hbase a= s data source in drill.=C2=A0 We don't want to use hbase client to scan dat= a(performance consideration). We divided the scan process into two parts, r= ead hfile directly and read data in memstore from region server.=0A=E5=9C= =A8 2013-3-21=EF=BC=8C=E4=B8=8B=E5=8D=885:31=EF=BC=8C Anoop Sam John =E5=86= =99=E9=81=93=EF=BC=9A=0A=0A> How you can be sure abt data will be in memsto= re only. What if in btw flush happening?=C2=A0 Which version in use?=0A> I= n 94.x version (I am not sure abt the .x version no#) there is preStoreScan= nerOpen() CP hook. This impl can return a KVScanner for a store (In your im= pl the scanner can be only for Memstore?). Pls see how this hook is being u= sed and how the StoreScanner is being created.=0A> =0A> Can you think of co= ntrol this using TimeRange on Scan ?=0A> =0A> -Anoop-=0A> _________________= _______________________=0A> From: Snake [yfwang@xingcloud.com]=0A> Sent: Th= ursday, March 21, 2013 2:35 PM=0A> To: user@hbase.apache.org=0A> Subject: I= s there a way to only scan data in memstore=0A> =0A> Hi,=0A> =0A> I just wa= nt to scan data in memstore, but I saw InternalScan is private class.=C2=A0= Is there a way i can do it without change the hbase source code?=0A> =0A> = Thanks,=0A> Snake --969045052-2020399676-1363925963=:78761--