hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12949) Add metrics and HTrace to the s3a connector
Date Tue, 22 Mar 2016 21:55:25 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207387#comment-15207387
] 

Colin Patrick McCabe commented on HADOOP-12949:
-----------------------------------------------

Thanks, [~steve_l].  Providing a rolling window of metrics seems useful.  It might be worth
doing that in a follow-on JIRA, since it seems like it might involve some major code reorganization.
 I also wonder whether these metrics should be added to HDFS as well (how datastore-neutral
are they?)

> Add metrics and HTrace to the s3a connector
> -------------------------------------------
>
>                 Key: HADOOP-12949
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12949
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Madhawa Gunasekara
>
> Hi All, 
> s3, GCS, WASB, and other cloud blob stores are becoming increasingly important in Hadoop.
But we don't have distributed tracing for these yet. It would be interesting to add distributed
tracing here. It would enable collecting really interesting data like probability distributions
of PUT and GET requests to s3 and their impact on MR jobs, etc.
> I would like to implement this feature, Please shed some light on this 
> Thanks,
> Madhawa



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message