Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of amits@infolinks.com designates
 207.126.144.137 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CA+RK=_ACBmhbhJHv1vmdEKhZB236YDB03u+09UB2RcJGq6KT-g@mail.gmail.com>
References: 
 <CAAMYKhqPizLtBHbUgcF_oce5wKrK_U9W4y4qGFzUTvjQcatbDw@mail.gmail.com>
	<18B64CB4-94DB-40F1-B9D3-D6949FB6E7FD@gmail.com>
	<CAAMYKhraDKtNBaDDg=u-aTBJzNcxCEUjRdLv1-SpDp1fege61g@mail.gmail.com>
	<CA+RK=_ACBmhbhJHv1vmdEKhZB236YDB03u+09UB2RcJGq6KT-g@mail.gmail.com>
Date: Thu, 6 Dec 2012 10:05:59 +0200
Message-ID: 
 <CAAMYKhrBuvD8_998=hT8CY8Ai-XLvv9nO3PWoozBvsXsOe0RJw@mail.gmail.com>
Subject: Re: Can a RegionObserver coprocessor increment counter of a row key
 that may not belong to the region ?
From: Amit Sela <amits@infolinks.com>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=bcaec554dbcac0a57804d02a91bd

--bcaec554dbcac0a57804d02a91bd
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

If I'm aggregating over the same Increment Object that triggered the
Observer (the same key, same CFs but aggregating into different
qualifiers), do I go outside the Region ?
I know that for the cases I mentioned earlier I do but in the case I
describe here don't I stay in the region ?


On Thu, Dec 6, 2012 at 9:40 AM, Andrew Purtell <apurtell@apache.org> wrote:

> Summing/aggregating with a Coprocessor seems like a fine use, but it
> should act upon only the data within the region to which it is
> associated.
>
> However if it seems your Coprocessor must unavoidably update or access
> data outside of its region, then either your schema design should
> change (such that all data the coprocessor will operate on is
> contained within the keyspace of the region); or, you should exclude
> all possible client side options. For example maybe Datacube will work
> for you here? See http://github.com/urbanairship/datacube
>
> On 12/6/12, Amit Sela <amits@infolinks.com> wrote:
> > I asked because I thought exactly what you all said but wanted to be
> sure.
> > My case is incrementing counters per URL where the families are time
> > periods (hourly, daily...) and the qualifiers are
> > impressions_criteria1,impressions_criteria2... I am going to use
> > coprocessors in order to sum all impressions counters (all criteria
> > segments) and then increment another counter (general count) that belon=
gs
> > to the same URL.
> > Is that a good practice for Coprocessors (Observer) ?
> >
> > Thanks.
> >
> >
> > On Wed, Dec 5, 2012 at 8:56 PM, Asaf Mesika <asaf.mesika@gmail.com>
> wrote:
> >
> >> Why not simply send Increment objects from the client side to HBase, t=
o
> >> the URL row key and to the domain row key?
> >>
> >> On 5 =D7=91=D7=93=D7=A6=D7=9E 2012, at 14:35, Amit Sela <amits@infolin=
ks.com> wrote:
> >>
> >> > Hi all,
> >> >
> >> > I have to count the occurrence of URLs in our system using the URL a=
s
> >> > row
> >> > key and using Increment.
> >> > I also want to count domains, so I was thinking of using
> RegionObserver
> >> > coprocessor on postIncrement() and Increment using the domain as key=
.
> >> >
> >> > Will that work ? Is there a problem if the url key starts with 'www.=
'
> >> > and
> >> > the domain starts with 'aaaa' ?
> >> >
> >> > Thanks,
> >> >
> >> > Amit.
> >>
> >>
> >
>

--bcaec554dbcac0a57804d02a91bd--