accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Fuchs (JIRA)" <>
Subject [jira] [Updated] (ACCUMULO-3300) monitor ingest, query, etc. rates are too smooth
Date Wed, 05 Nov 2014 14:57:33 GMT


Adam Fuchs updated ACCUMULO-3300:
    Attachment: smoothed_0.2.png

The two attached images show a ci test run twice with smoothing parameters set to 0.2 and
0.95. The .95 version converges on an accurate measurement much more quickly when rates change,
and you can see more clearly that there is a square wave of ingest performance. Features like
the dip after the third hump wouldn't have shown up in the 0.2 version, and would have simply
been smoothed away.

> monitor ingest, query, etc. rates are too smooth
> ------------------------------------------------
>                 Key: ACCUMULO-3300
>                 URL:
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: monitor, tserver
>            Reporter: Adam Fuchs
>         Attachments: smoothed_0.2.png, smoothed_0.95.png
> We use an exponential decay function to smooth performance monitoring. This dates back
to the early days of the project when we were taking samples frequently and everything looked
like noise. Now our performance is a bit more steady and we take samples about every 5 seconds.
I think we need to update some parameters so that finer-grained performance characteristics
show up in the monitor. This is critical for the next wave of Accumulo performance improvements.

This message was sent by Atlassian JIRA

View raw message