hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Zhuge (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-12877) Add ADLS telemetry instrumentation
Date Thu, 19 Oct 2017 05:45:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

John Zhuge updated HADOOP-12877:
--------------------------------
    Description: 
Currently the connector/SDK adds these 4 telemetry fields to the User Agent suffix of each
HTTP request to ADLS:
{noformat}
hadoop-azure-datalake-<version>/<version>/<clusterName>/<clusterType>
{noformat}

Field <clusterName> can be set by configuration property {{adl.events.tracking.clustername}}.
Field <clusterType> can be set by configuration property {{adl.events.tracking.clustertype}}.

The <version> string is repeated. It does not seem necessary.
All fields except the first are also added to HTTP request property {{x-ms-tracking-info}}.

Suggest adding a custom field to the user agent suffix and changing the first field to just
"Hadoop":
{noformat}
Hadoop/<version>/<clusterName>/<clusterType>/<custom>
{noformat}
Field <custom> can be set by a new configuration property {{fs.adl.user.agent.suffix}}.


  was:
Currently the connector/SDK adds these 4 telemetry field to the User Agent suffix of each
HTTP request to ADLS:
{noformat}
hadoop-azure-datalake-<version>/<version>/<clusterName>/<clusterType>
{noformat}

Field <clusterName> can be set by configuration property {{adl.events.tracking.clustername}}.
Field <clusterType> can be set by configuration property {{adl.events.tracking.clustertype}}.

<version> is repeated.
All fields except the first are also added to HTTP request property {{x-ms-tracking-info}}.

Suggest a custom field to the user agent suffix and change the first field to just "Hadoop":
{noformat}
Hadoop/<version>/<clusterName>/<clusterType>/<custom>
{noformat}
Field <custom> can be set by a new configuration property {{fs.adl.user.agent.suffix}}.



> Add ADLS telemetry instrumentation
> ----------------------------------
>
>                 Key: HADOOP-12877
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12877
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/adl
>            Reporter: Vishwajeet Dusane
>            Assignee: Vishwajeet Dusane
>
> Currently the connector/SDK adds these 4 telemetry fields to the User Agent suffix of
each HTTP request to ADLS:
> {noformat}
> hadoop-azure-datalake-<version>/<version>/<clusterName>/<clusterType>
> {noformat}
> Field <clusterName> can be set by configuration property {{adl.events.tracking.clustername}}.
> Field <clusterType> can be set by configuration property {{adl.events.tracking.clustertype}}.
> The <version> string is repeated. It does not seem necessary.
> All fields except the first are also added to HTTP request property {{x-ms-tracking-info}}.
> Suggest adding a custom field to the user agent suffix and changing the first field to
just "Hadoop":
> {noformat}
> Hadoop/<version>/<clusterName>/<clusterType>/<custom>
> {noformat}
> Field <custom> can be set by a new configuration property {{fs.adl.user.agent.suffix}}.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message