accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Fuchs (JIRA)" <>
Subject [jira] [Commented] (ACCUMULO-3300) monitor ingest, query, etc. rates are too smooth
Date Wed, 05 Nov 2014 22:25:34 GMT


Adam Fuchs commented on ACCUMULO-3300:

[~mdrob] Are you concerned that some people will not like this change? I would shy away from
adding extra parameters for this due to the already high complexity of our configuration.
I think the future of this feature ought to be migration to some sort of standard instead,
like opentsdb. Can you think of a way to do this that reduces the complexity of core Accumulo?

> monitor ingest, query, etc. rates are too smooth
> ------------------------------------------------
>                 Key: ACCUMULO-3300
>                 URL:
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: monitor, tserver
>            Reporter: Adam Fuchs
>            Assignee: Adam Fuchs
>             Fix For: 1.6.2, 1.7.0
>         Attachments: monitor_smoothing.patch, smoothed_0.2.png, smoothed_0.95.png
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
> We use an exponential decay function to smooth performance monitoring. This dates back
to the early days of the project when we were taking samples frequently and everything looked
like noise. Now our performance is a bit more steady and we take samples about every 5 seconds.
I think we need to update some parameters so that finer-grained performance characteristics
show up in the monitor. This is critical for the next wave of Accumulo performance improvements.

This message was sent by Atlassian JIRA

View raw message