Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of jdcryans@gmail.com designates
 209.85.160.169 as permitted sender)
MIME-Version: 1.0
Sender: jdcryans@gmail.com
In-Reply-To: 
 <CAP+k-sf9kAEUnUv1sK2E2temU2_VMYCioood8o2xJ==qn4-P+g@mail.gmail.com>
References: 
 <CAP+k-sf9kAEUnUv1sK2E2temU2_VMYCioood8o2xJ==qn4-P+g@mail.gmail.com>
Date: Tue, 19 Jun 2012 09:55:47 -0700
Message-ID: 
 <CAGpTDNfS3m3yZqvuqbsKORHBGpHGti_YEJaHGFcTCV=APp1tmQ@mail.gmail.com>
Subject: Re: Increment Counters in HBase during MapReduce
From: Jean-Daniel Cryans <jdcryans@apache.org>
To: user@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

This question was answered here already:
http://mail-archives.apache.org/mod_mbox/hbase-user/201101.mbox/%3CAANLkTin=
nW2d7DMCyFu3ptv1Hu_i3XqK_1pDSgD5NT_Lk@mail.gmail.com%3E

Counters are not idempotent, this can be hard to manage.

J-D

On Mon, Jun 18, 2012 at 5:49 PM, Sid Kumar <sqlsid101@gmail.com> wrote:
> Hi everyone,
>
> =A0 =A0I have a use case in HBase that I was wondering if someone may hav=
e
> stumbled upon. I am maintaining an ad impressions table with columns that
> are counters for certain metrics. I started using the incrementColumnValu=
e
> method part of the HTable API to update these metrics and that works grea=
t.
> =A0 =A0I was wondering if this function could be used from a MapReduce jo=
b.
> The TableOutputFormat supports only Delete and Put operations. Using the
> Incremental counters saves me from doing any aggregations in my Map Reduc=
e
> code. Ideally i would like to just call this function in my mapper and
> wouldn't even need a Reducer.
> =A0 =A0Has anyone run into this use case? I would also love to know if th=
ere
> are any better alternatives of solving this too. Any info would be great.
>
> Thanks
> Sid