aurora-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tony Dong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AURORA-1472) TaskThrottle should have a configurable jitter
Date Fri, 25 Dec 2015 10:28:49 GMT

    [ https://issues.apache.org/jira/browse/AURORA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071493#comment-15071493
] 

Tony Dong commented on AURORA-1472:
-----------------------------------

I probably went a little bit overboard in the code change. https://reviews.apache.org/r/41717/
:)
I implemented the different backoff+jittering algorithms outlined here: http://www.awsarchitectureblog.com/2015/03/backoff.html
and also made the backoff strategy more guice friendly.

> TaskThrottle should have a configurable jitter
> ----------------------------------------------
>
>                 Key: AURORA-1472
>                 URL: https://issues.apache.org/jira/browse/AURORA-1472
>             Project: Aurora
>          Issue Type: Story
>          Components: Scheduler
>            Reporter: Stephan Erb
>            Assignee: Tony Dong
>              Labels: newbie
>
> As an Aurora cluster operator, I need the ability to configure a random jitter which
is added to the [throttle time of flapping jobs|https://github.com/apache/aurora/blob/06ddaadbcba4c66b8019815de6ca27d50a9df77d/src/main/java/org/apache/aurora/scheduler/scheduling/TaskThrottler.java#L73].

> Background information: Due to some cascading failures, we ended in a state where many
instances where throttled. Unfortunately, all these instances were restarted at the exact
same time. This overloaded a backend used for package retrieval. A random jitter would have
helped us to spread out the load on the backend service.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message