hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12975) Add jitter to DU's thread
Date Mon, 04 Apr 2016 23:47:25 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225299#comment-15225299

Colin Patrick McCabe commented on HADOOP-12975:

Good idea.

Can we make the jitter percentage configurable?  What motivates choosing 50% of the full refresh
period as the jitter default?  For people with really long DU periods, this could extend that
refresh time by quite a bit.  Perhaps jitter should be specified as a maximum number of seconds
uniformly randomly added, rather than a percentage of the full refresh period?

I think this can get in separately from HADOOP-12973.

> Add jitter to DU's thread
> -------------------------
>                 Key: HADOOP-12975
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12975
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>         Attachments: HADOOP-12975v0.patch, HADOOP-12975v1.patch
> Running DU across lots of disks is very expensive and running all of the processes at
the same time creates a noticeable IO spike. We should add some jitter.

This message was sent by Atlassian JIRA

View raw message