Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3340E1165C for ; Sat, 12 Apr 2014 01:20:43 +0000 (UTC) Received: (qmail 8304 invoked by uid 500); 12 Apr 2014 01:20:39 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 8252 invoked by uid 500); 12 Apr 2014 01:20:39 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 8244 invoked by uid 99); 12 Apr 2014 01:20:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 12 Apr 2014 01:20:39 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Chandra.Bogala@gs.com designates 204.4.178.100 as permitted sender) Received: from [204.4.178.100] (HELO mxecd09.gs.com) (204.4.178.100) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 12 Apr 2014 01:20:33 +0000 X-IronPort-AV: E=Sophos;i="4.97,845,1389762000"; d="scan'208,217";a="59407013" Received: from unknown (HELO mxpbd02-public.ny.fw.gs.com) ([148.86.115.129]) by mxecd09.idz.gs.com with ESMTP; 11 Apr 2014 21:20:09 -0400 From: "Bogala, Chandra Reddy" X-sendergroup: RELAYLIST Received: from gshcbdp13ex.firmwide.corp.gs.com ([10.135.172.22]) by mxpbd02.ny.fw.gs.com with ESMTP; 11 Apr 2014 21:20:09 -0400 Received: from GSCMBLP12EX.firmwide.corp.gs.com ([139.172.99.7]) by gshcbdp13ex.firmwide.corp.gs.com ([10.135.172.22]) with mapi; Fri, 11 Apr 2014 21:20:07 -0400 To: "'user@hbase.apache.org'" Date: Fri, 11 Apr 2014 21:20:06 -0400 Subject: RE: endpoint coprocessor Thread-Topic: endpoint coprocessor Thread-Index: Ac9VqSpAtvcF+TIrRoqRhNgWQQWKqQAQnDLw Message-ID: <0A88212BF9DDF54FBEE61A2C1965291D032B587D3B@GSCMBLP12EX.firmwide.corp.gs.com> References: <0A88212BF9DDF54FBEE61A2C1965291D032B587CB2@GSCMBLP12EX.firmwide.corp.gs.com> <0A88212BF9DDF54FBEE61A2C1965291D032B587D2D@GSCMBLP12EX.firmwide.corp.gs.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US x-retentionstamp: Firmwide Content-Type: multipart/alternative; boundary="_000_0A88212BF9DDF54FBEE61A2C1965291D032B587D3BGSCMBLP12EXfi_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_0A88212BF9DDF54FBEE61A2C1965291D032B587D3BGSCMBLP12EXfi_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Thanks Yu. My understanding is, this coprocessor is available as part of Hb= ase server components. So I should be able to attach this coprocessor to an= y of my tables by using alter table command. alter 'demo-table','COPROCESSOR' =3D>'|class|priority|args' Then from hbase shell, I should be able to call this coprocessor with comma= nd. Same like how we do scan and filter. Is there any command like below(fi= lter command) calling a coprocessor. So that it will run in region server a= nd return back results?. scan 'demo-table', {FILTER =3D> org.apache.hadoop.hbase.filter.RowFilter.ne= w(CompareFilter::CompareOp.valueOf('EQUAL'),SubstringComparator.new("10001|= 1395309600"))} I am trying to figure out a simple call mechanism(client) of coprocessor. I= f by default those classes and calling mechanism not available from hbase s= hell. Then planning to use java client code to invoke coprocessor. Any pointers to java client to invoke aggregation coprocessor will be h= elpful. Thanks, Chandra -----Original Message----- From: Ted Yu [mailto:yuzhihong@gmail.com] Sent: Friday, April 11, 2014 10:42 PM To: user@hbase.apache.org Subject: Re: endpoint coprocessor Please take a look at : hbase-shell/src/main/ruby/hbase/security.rb for example on how coprocessor is activated from shell. Cheers On Fri, Apr 11, 2014 at 11:06 AM, Bogala, Chandra Reddy < Chandra.Bogala@gs= .com> wrote: > Thank you. I am aware of this challenge. How to call below coprocessor > from client. Can I call this coprocessor from hbase shell?. I am new > to Hbase. So may be asking very dumb questions. > > Thanks, > Chandra > > -----Original Message----- > From: Asaf Mesika [mailto:asaf.mesika@gmail.com] > Sent: Friday, April 11, 2014 12:10 PM > To: user@hbase.apache.org > Subject: Re: endpoint coprocessor > > Bear in mind each region will return its top n, then you will have to > run another top n in your client code. This introduce a numerical > error : top on top. > > On Thursday, April 10, 2014, Bogala, Chandra Reddy > > > wrote: > > > Hi, > > I am planning to write endpoint coprocessor to calculate TOP N > > results for my usecase. I got confused with old apis and new apis. > > I followed below links and try to implement. But looks like api's > > changed a lot. I don't see many of these classes in hbase jars. We > > are using Hbase 0.96. > > Can anyone point to the latest document/apis?. And if possible > > sample code to calculate top N. > > > > https://blogs.apache.org/hbase/entry/coprocessor_introduction > > HBase Coprocessors - Deploy shared functionality directly on the > > cluster > > > > Thanks, > > Chandra > > > > > > > --_000_0A88212BF9DDF54FBEE61A2C1965291D032B587D3BGSCMBLP12EXfi_--