hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13028) add counter and timer metrics for S3A operations
Date Fri, 15 Apr 2016 11:35:25 GMT
Steve Loughran created HADOOP-13028:

             Summary: add counter and timer metrics for S3A operations
                 Key: HADOOP-13028
                 URL: https://issues.apache.org/jira/browse/HADOOP-13028
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3, metrics
    Affects Versions: 2.8.0
            Reporter: Steve Loughran
            Priority: Minor

against S3 (and other object stores), opening connections can be expensive, closing connections
may be expensive (a sign of a regression). 

S3A FS and individual input streams should have counters of the # of open/close/failure+reconnect
operations, timers of how long things take. This can be used downstream to measure efficiency
of the code (how often connections are being made), connection reliability, etc.

This message was sent by Atlassian JIRA

View raw message