Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 9897 invoked from network); 2 Feb 2011 03:59:33 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 2 Feb 2011 03:59:33 -0000 Received: (qmail 62909 invoked by uid 500); 2 Feb 2011 03:59:30 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 62547 invoked by uid 500); 2 Feb 2011 03:59:28 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 62533 invoked by uid 99); 2 Feb 2011 03:59:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Feb 2011 03:59:27 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of qwertymaniac@gmail.com designates 209.85.161.48 as permitted sender) Received: from [209.85.161.48] (HELO mail-fx0-f48.google.com) (209.85.161.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Feb 2011 03:59:21 +0000 Received: by fxm2 with SMTP id 2so8170080fxm.35 for ; Tue, 01 Feb 2011 19:59:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type:content-transfer-encoding; bh=Rzx49m1qedyz/xyrewd812maPUvRlld9gvcw/z01br4=; b=f5Suu/bwbFTxisOw8Qx2KYvnxePRh04poiG2iRvwL/dF6ZzmtlssKJYwrCIjkuvzn0 g6yMJG//oCk4DUqGLJqCoJMuaRPWOXlu4nSbtKAuAIi3m9T84oy7n+wvF46Q13zCsNOQ OI4fLnba5TiKBHn/JG4uKzm90mSZkaVCOfpAc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; b=tEGX2877rTUefUnSEDeHp75ilkIOaATeN23soS/4brMS+9lcAsnG+vZJ32YMyhaMnC phwU9qgN2t7QukAelnNBMCWsHnK4Gkf7rNgn1GwJ2rC4l+UOxc3T9yHk3TXZY8/bWjuG tIBwcXqAGa+Y5j1QptsItBAlUmQBZFnQm8aNE= Received: by 10.223.116.1 with SMTP id k1mr8310721faq.51.1296619140217; Tue, 01 Feb 2011 19:59:00 -0800 (PST) MIME-Version: 1.0 Received: by 10.223.124.200 with HTTP; Tue, 1 Feb 2011 19:58:40 -0800 (PST) In-Reply-To: <1CF337FE-06DD-4FFC-AA36-4764E2B28AE3@keithwiley.com> References: <20E4EF03-255E-4B1D-A6B7-DAF003FD4258@keithwiley.com> <1CF337FE-06DD-4FFC-AA36-4764E2B28AE3@keithwiley.com> From: Harsh J Date: Wed, 2 Feb 2011 09:28:40 +0530 Message-ID: Subject: Re: Streaming reporter counter update To: common-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Group is more of a meta-data thing. For instance, one may want all FileSystem related counters under a single namespace (which would be a Group, here). On Wed, Feb 2, 2011 at 2:17 AM, Keith Wiley wrote: > Ah, so count doesn't "set" the count, it increments it, meaning I shouldn= 't increment it each time. =A0That would result in some sort of strange exp= onential counter. =A0I should just pass 1 every time. =A0I get it. > > I'm still unclear on the distinction between the group and the individual= counter, but I'll read up on that on my own. > > Thanks. > > On Feb 1, 2011, at 12:31 , Harsh J wrote: > >> A 'group' is a set of counters (like 'Map-Reduce Framework' in default >> counters -> That's a group name). A 'counter' needs a name to signify >> what it is about. >> >> The increment is what the 'amount' signifies. Generally 1, but can be >> any amount you need to increment the current count by. All counters >> are of Long type. Floats are not acceptable AFAIK. >> >> Example: >> reporter:counter:Aliens,Mars,1 would +1 the global counter >> [Aliens].Mars and reporter:counter:Aliens,Unknown,10 would +10 the >> global counter [Aliens].Unknown. >> >> Counters are aggregated together across all launched tasks, so you >> don't need to worry about aggregating them yourselves. Each Map/Reduce >> task needs only to count its own needed counters up from 0. > > > _________________________________________________________________________= _______ > Keith Wiley =A0 =A0 =A0 =A0 =A0 =A0 =A0 kwiley@keithwiley.com =A0 =A0 =A0= =A0 =A0 =A0 =A0 www.keithwiley.com > > "I used to be with it, but then they changed what it was. =A0Now, what I'= m with > isn't it, and what's it seems weird and scary to me." > =A0-- Abe (Grandpa) Simpson > _________________________________________________________________________= _______ > > > > --=20 Harsh J www.harshj.com