Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 518A011186 for ; Fri, 16 May 2014 14:06:54 +0000 (UTC) Received: (qmail 50713 invoked by uid 500); 16 May 2014 11:45:44 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59015 invoked by uid 500); 16 May 2014 11:31:31 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 344 invoked by uid 99); 16 May 2014 11:22:45 -0000 Received: from Unknown (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 May 2014 11:22:45 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of clohfink@blackbirdit.com designates 209.85.213.171 as permitted sender) Received: from [209.85.213.171] (HELO mail-ig0-f171.google.com) (209.85.213.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 May 2014 20:37:00 +0000 Received: by mail-ig0-f171.google.com with SMTP id c1so8433762igq.10 for ; Thu, 15 May 2014 13:36:37 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:content-type:message-id:mime-version :subject:date:references:to:in-reply-to; bh=KhSjVkyNOkyEITNx5w0ORPv7+m5KztCyhk8JcIOlb6s=; b=B1E7+e4pFN8Or+yh60jDwIynRVBu3gc6Kk8ZSalpCHXIJLYXrcisVEYqR/BxveREDO ZXv6pnlDQxDL3XfkVfnVrWFsmQVLHoF2m2vjWP96pPlWdQfV6ARhJBAQhJ3LVQ50wb6i hRNrFPug0+9cj/NaaN5Nq/of14wWz+cQOB948uNwtlvu3ov99L+pNb8//C05PfgoNiVq iX4iUhGe1P00b8NO8M68loDTrCgEQ/mBXOUusGAkB6jxqGEZQHvOmhjNahfZSCiGHU0y Vr++GZLeRNKuv6VYSGUDFYolSsApVxGwKPNoMV9FOSFzQO4TZiiBujL7ezRJYbrUnsvQ Zt5Q== X-Gm-Message-State: ALoCoQnij4nlMUiAV/Dq8R8J53idA1jmXbLHzbN4SXbFocAtzvseAhTxlj4fPqNgVjmgnDIeqnQO X-Received: by 10.50.238.229 with SMTP id vn5mr15315509igc.45.1400186196957; Thu, 15 May 2014 13:36:36 -0700 (PDT) Received: from [10.10.10.100] (97-86-246-164.dhcp.roch.mn.charter.com. [97.86.246.164]) by mx.google.com with ESMTPSA id hi8sm48107771igb.8.2014.05.15.13.36.35 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 15 May 2014 13:36:36 -0700 (PDT) From: Chris Lohfink Content-Type: multipart/alternative; boundary="Apple-Mail=_20DE8A8D-7D50-437E-802D-01964122C15E" Message-Id: <91CF9075-DDBE-4DBD-BAEA-2EA47A4A4A3E@blackbirdit.com> Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\)) Subject: Re: What does the "rate" signify for latency in the JMX Metrics? Date: Thu, 15 May 2014 15:36:33 -0500 References: <536A74D6.9020404@gmail.com> To: user@cassandra.apache.org In-Reply-To: <536A74D6.9020404@gmail.com> X-Mailer: Apple Mail (2.1874) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_20DE8A8D-7D50-437E-802D-01964122C15E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > What does the rate signify in this context? For example, given the = OneMinuteRate of 675.7673129014964 and the unit of "seconds"--what is = this measuring? means that there were 675 write requests per second over the last one = minute.=20 As Other Chris (tm) mentioned this is exp decaying reservoir. Uses an exponentially decaying sample of 1028 elements, which = offers a 99.9% confidence level with a 5% margin of error assuming a normal distribution, = and an alpha factor of 0.015 which heavily biases the sample to the past 5 minutes of = measurements. http://dimacs.rutgers.edu/~graham/pubs/papers/fwddecay.pdf --- Chris Lohfink On May 7, 2014, at 1:00 PM, Chris Burroughs = wrote: > They are exponential decaying moving averages (like Unix load = averages) of the number of events per unit of time. >=20 > http://wiki.apache.org/cassandra/Metrics might help >=20 > On 04/17/2014 06:06 PM, Redmumba wrote: >> Good afternoon, >>=20 >> I'm attempting to integrate the metrics generated via JMX into our = internal >> framework; however, the information for several of the metrics = includes a >> One/Five/Fifteen-minute "rate", with the RateUnit in "SECONDS". For >> example: >>=20 >> $>get -b >>> = org.apache.cassandra.metrics:name=3DLatency,scope=3DWrite,type=3DClientReq= uest * >>> #mbean =3D >>> = org.apache.cassandra.metrics:name=3DLatency,scope=3DWrite,type=3DClientReq= uest: >>> LatencyUnit =3D MICROSECONDS; >>>=20 >>> EventType =3D calls; >>>=20 >>> RateUnit =3D SECONDS; >>>=20 >>> MeanRate =3D 383.6944837362387; >>>=20 >>> FifteenMinuteRate =3D 868.8420188648543; >>>=20 >>> FiveMinuteRate =3D 817.5239450236011; >>>=20 >>> OneMinuteRate =3D 675.7673129014964; >>>=20 >>> Max =3D 498867.0; >>>=20 >>> Count =3D 31257426; >>>=20 >>> Min =3D 52.0; >>>=20 >>> 50thPercentile =3D 926.0; >>>=20 >>> Mean =3D 1063.114029159023; >>>=20 >>> StdDev =3D 1638.1542477604232; >>>=20 >>> 75thPercentile =3D 1064.75; >>>=20 >>> 95thPercentile =3D 1304.55; >>>=20 >>> 98thPercentile =3D 1504.3999999999992; >>>=20 >>> 99thPercentile =3D 2307.3500000000104; >>>=20 >>> 999thPercentile =3D 10491.850000000002; >>>=20 >>=20 >> What does the rate signify in this context? For example, given the >> OneMinuteRate of 675.7673129014964 and the unit of "seconds"--what = is this >> measuring? Is this the rate of which metrics are submitted? i.e., = there >> were an average of (676 * 60 seconds) metrics submitted over the last >> minute? >>=20 >> Thanks! >>=20 >=20 --Apple-Mail=_20DE8A8D-7D50-437E-802D-01964122C15E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii
What does = the rate signify in this context?  For example, given the = OneMinuteRate of  675.7673129014964 and the unit of "seconds"--what = is this measuring?

means that = there were 675 write requests per second over the last one = minute. 

As Other Chris (tm) mentioned = this is exp decaying reservoir.

  =        Uses an exponentially decaying sample of 1028 = elements, which offers a 99.9% confidence
      =    level with a 5% margin of error assuming a normal = distribution, and an alpha factor of 0.015
  =  which heavily biases = the sample to the past 5 minutes of = measurements.


---
Chris Lohfink

On May 7, = 2014, at 1:00 PM, Chris Burroughs <chris.burroughs@gmail.com>= ; wrote:

They are exponential decaying moving averages (like Unix = load averages) of the number of events per unit of time.

http://wiki.apache.org/c= assandra/Metrics might help

On 04/17/2014 06:06 PM, Redmumba = wrote:
Good afternoon,

I'm = attempting to integrate the metrics generated via JMX into our = internal
framework; however, the information for several of the = metrics includes a
One/Five/Fifteen-minute "rate", with the RateUnit = in "SECONDS".  For
example:

$>get -b
org.apache.cassandra.metrics:name=3DLatency,scope=3DWrite,ty= pe=3DClientRequest *
#mbean = =3D
org.apache.cassandra.metrics:name=3DLatency,scope=3DWrite,type=3DCl= ientRequest:
LatencyUnit =3D MICROSECONDS;

EventType =3D = calls;

RateUnit =3D SECONDS;

MeanRate =3D = 383.6944837362387;

FifteenMinuteRate =3D = 868.8420188648543;

FiveMinuteRate =3D = 817.5239450236011;

OneMinuteRate =3D = 675.7673129014964;

Max =3D 498867.0;

Count =3D = 31257426;

Min =3D 52.0;

50thPercentile =3D = 926.0;

Mean =3D 1063.114029159023;

StdDev =3D = 1638.1542477604232;

75thPercentile =3D = 1064.75;

95thPercentile =3D 1304.55;

98thPercentile =3D = 1504.3999999999992;

99thPercentile =3D = 2307.3500000000104;

999thPercentile =3D = 10491.850000000002;


What does the rate signify = in this context?  For example, given the
OneMinuteRate of =  675.7673129014964 and the unit of "seconds"--what is = this
measuring?  Is this the rate of which metrics are = submitted? i.e., there
were an average of (676 * 60 seconds) metrics = submitted over the = last
minute?

Thanks!


=
= --Apple-Mail=_20DE8A8D-7D50-437E-802D-01964122C15E--