Mailing-List: contact user-help@commons.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Commons Users List" <user@commons.apache.org>
Received-SPF: pass (nike.apache.org: domain of ted.dunning@gmail.com
 designates 209.85.220.171 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :cc:content-type;
        b=muGrsbRASdxIp+4lXJeEqskLOXDuacIBKbyGeqgwE7u8YvoiYk9UmBbbpS0BacWhrA
         UifLLtfr+cMvwCXjin98wMdNkKdtqcJA49SmOZWUFJA5UVBNzbt0Q87syeGErmtPKGjC
         XuyQrCSSLYSVHWEY1rUNYOV5+p1H4j3+JVL6I=
MIME-Version: 1.0
In-Reply-To: <AANLkTi=3NzxTJYv86t8gfjJdkQuYSer0r4+s0yJ5=zcy@mail.gmail.com>
References: <AANLkTi=3NzxTJYv86t8gfjJdkQuYSer0r4+s0yJ5=zcy@mail.gmail.com>
From: Ted Dunning <ted.dunning@gmail.com>
Date: Mon, 14 Mar 2011 07:49:15 -0700
Message-ID: <AANLkTim_dA61p8Taeq3kAbeO6HOTetM3ZXH8Qxd92dkm@mail.gmail.com>
Subject: Re: running average of a rate
To: Commons Users List <user@commons.apache.org>
Cc: Benson Margulies <bimargulies@gmail.com>
Content-Type: multipart/alternative; boundary=20cf3054aa3318b942049e726ccb

--20cf3054aa3318b942049e726ccb
Content-Type: text/plain; charset=UTF-8

For the overall average you need is the total time and total characters.  Do
the division at presentation time.

If you want a decaying moving average, then a variant on Welford's method is
useful for an on-line estimate.  I just had such a discussion in the hbase
group.  For that you need state, however, and atomic updates.  A useful
approximation might be possible if you can report many moving averages which
can themselves be averaged.

Can you say a bit more about your context?  Is this in hadoop?  Did you want
to maintain the average across the cluster?  Did you want real averages or a
moving average?  Do you have constant sampling rate?

On Mon, Mar 14, 2011 at 7:33 AM, Benson Margulies <bimargulies@gmail.com>wrote:

> Please excuse the following ignorant question.
>
> I want to maintain summary statistics of a rate. At each 'event', I
> know the number of characters and the time it took to process them,
> and I want to maintain summary statistics for the rate of
> chars/second. I imagine that I'm missing something basic, but I don't
> see how to do this.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
>
>

--20cf3054aa3318b942049e726ccb--