hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15965) Upgrade to ADLS SDK which has major performance improvement for ingress/egress
Date Mon, 03 Dec 2018 14:31:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707275#comment-16707275
] 

Steve Loughran commented on HADOOP-15965:
-----------------------------------------

* make sure it works when wildfly isn't on the CP, and doesn't bother warning people at info/warn
* can you make sure the SDK checks content tyoe of Auth & raises meaningful error if !=
json 
* review all transitive dependencies: is it going to force in new versions of anything?
* and of course, usual "test everything process" applies

> Upgrade to ADLS SDK which has major performance improvement for ingress/egress
> ------------------------------------------------------------------------------
>
>                 Key: HADOOP-15965
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15965
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/adl
>            Reporter: Vishwajeet Dusane
>            Priority: Major
>
> Upgrade ADLS SDK to version 2.3.2 which has major improvements
>  # Add special handling for 404 errors when requesting tokens from MSI
>  # Fix liststatus response parsing when filestatus object contains array in one field.
>  # Use wildfly openssl native binding with Java. This is a workaround to [https://bugs.openjdk.java.net/browse/JDK-8046943]issue.
2X performance boost over HTTPS. Similar to HADOOP-15669



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message