hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13028) add counter and timer metrics for S3A operations
Date Fri, 15 Apr 2016 11:35:25 GMT
Steve Loughran created HADOOP-13028:
---------------------------------------

             Summary: add counter and timer metrics for S3A operations
                 Key: HADOOP-13028
                 URL: https://issues.apache.org/jira/browse/HADOOP-13028
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3, metrics
    Affects Versions: 2.8.0
            Reporter: Steve Loughran
            Priority: Minor


against S3 (and other object stores), opening connections can be expensive, closing connections
may be expensive (a sign of a regression). 

S3A FS and individual input streams should have counters of the # of open/close/failure+reconnect
operations, timers of how long things take. This can be used downstream to measure efficiency
of the code (how often connections are being made), connection reliability, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message