hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13844) Move swift duration stats tracking to hadoop common utils
Date Tue, 29 Nov 2016 16:21:58 GMT
Steve Loughran created HADOOP-13844:

             Summary: Move swift duration stats tracking to hadoop common utils
                 Key: HADOOP-13844
                 URL: https://issues.apache.org/jira/browse/HADOOP-13844
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/azure, fs/oss, fs/s3, fs/swift
    Affects Versions: 2.9.0
            Reporter: Steve Loughran
            Assignee: Steve Loughran
            Priority: Minor

Swift FS has some simple duration counting classes which are used to track HTTP performance,
with incremental creation of mean, min, max and variance. These are not moving averages, simply
ongoing over time. They've proved useful in detecting which operations are slowest against
objects stores. (it turned out to be delete throttling in test teardown BTW, showing the value
of the instrumentation)

By moving them into utils, all the object stores can build up some stats on cost of HTTP operations.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

View raw message