cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Clément Lardeur (JIRA) <>
Subject [jira] [Commented] (CASSANDRA-11117) ColUpdateTimeDeltaHistogram histogram overflow
Date Mon, 22 Aug 2016 08:05:20 GMT


Clément Lardeur commented on CASSANDRA-11117:

Hi we have the same problem with the version 3.0.8, the graphite reporter stop working like

ERROR [metrics-graphite-reporter-1-thread-1] 2016-08-22 09:40:42,618
- RuntimeException thrown from GraphiteReporter#report. Exception was suppressed.
java.lang.IllegalStateException: Unable to compute ceiling for max when histogram overflowed
        at org.apache.cassandra.utils.EstimatedHistogram.rawMean(
        at org.apache.cassandra.metrics.EstimatedHistogramReservoir$HistogramSnapshot.getMean(
        at com.codahale.metrics.graphite.GraphiteReporter.reportHistogram(
        at ~[metrics-core-3.1.0.jar:3.1.0]
        at com.codahale.metrics.ScheduledReporter$ ~[metrics-core-3.1.0.jar:3.1.0]
        at java.util.concurrent.Executors$ [na:1.8.0_101]
        at java.util.concurrent.FutureTask.runAndReset( [na:1.8.0_101]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(
        at java.util.concurrent.ScheduledThreadPoolExecutor$
        at java.util.concurrent.ThreadPoolExecutor.runWorker(
        at java.util.concurrent.ThreadPoolExecutor$
        at [na:1.8.0_101]

I don't think that ticket should be flagged as Minor because it's impacting our production
monitoring of the cluster. Since the version 3.x with the incompatibility of OpsCenter, many
users switch to another monitoring solution so the graphite reporter is now more critical
for the OOS community than previously.

If I could help I can give you more details with our cluster settings.

> ColUpdateTimeDeltaHistogram histogram overflow
> ----------------------------------------------
>                 Key: CASSANDRA-11117
>                 URL:
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Chris Lohfink
>            Assignee: Joel Knighton
>            Priority: Minor
>             Fix For: 2.2.x, 3.0.x, 3.x
> {code}
> getting attribute Mean of org.apache.cassandra.metrics:type=ColumnFamily,name=ColUpdateTimeDeltaHistogram
threw an java.lang.IllegalStateException:
Unable to compute ceiling for max when histogram overflowed
> {code}
> Although the fact that this histogram has 164 buckets already, I wonder if there is something
weird with the computation thats causing this to be so large? It appears to be coming from
updates to system.local
> {code}
> org.apache.cassandra.metrics:type=Table,keyspace=system,scope=local,name=ColUpdateTimeDeltaHistogram
> {code}

This message was sent by Atlassian JIRA

View raw message