hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14963) Add HTrace to ADLS connector
Date Thu, 19 Oct 2017 09:34:01 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210780#comment-16210780

Steve Loughran commented on HADOOP-14963:

Why not create an uber-JIRA, "instrument the object stores" & link the others to it...theres'
one for S3A too. It'd be good to have a constants file somewhere for the names of the operations,

any helper classes needed to simplify this. I was thinking of a try-with-resources wrapper
try(HTracer trace=new HTracer("getFileStatus()") {
 return innerGetFileStatus(path);

Be interesting to see if we can use this in testing

> Add HTrace to ADLS connector
> ----------------------------
>                 Key: HADOOP-14963
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14963
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/adl
>    Affects Versions: 2.8.0
>            Reporter: John Zhuge
> Add Apache HTrace support to Hadoop ADLS connector in order to support distributed tracing.
> Make sure the connector and the ADLS SDK support B3 Propagation so that tracer/span IDs
are sent via HTTP request to ADLS backend.
> To build an entire distributed tracing solution for ADLS, we will also need these components:
> * ADLS backend should support one of the Tracers. See http://opentracing.io/documentation/pages/supported-tracers.html.
> * Zipkin Collector: Event Hub
> * Zipkin Storage: MySQL

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message