hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Sasaki (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13044) Amazon S3 library 10.10.60+ (JDK8u60+) depends on http components 4.3
Date Sat, 23 Apr 2016 02:52:13 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255089#comment-15255089
] 

Kai Sasaki commented on HADOOP-13044:
-------------------------------------

Yes, as you said. 10.10.6 depends on [httpclient:4.3.6|https://github.com/aws/aws-sdk-java/blob/cb4fa451e98099dfeac6f804eb72e215c04bd240/aws-java-sdk-core/pom.xml#L24-L28],
but 4.2.5 is actually used since it is specified by Hadoop POM. This can cause anyway same
issue though it's not surfaced yet.

> Amazon S3 library 10.10.60+ (JDK8u60+) depends on http components 4.3
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-13044
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13044
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build, fs/s3
>    Affects Versions: 2.8.0
>         Environment: JDK 8u60
>            Reporter: Kai Sasaki
>            Assignee: Kai Sasaki
>         Attachments: HADOOP-13044.01.patch
>
>
> In case of using AWS SDK in the classpath of hadoop, we faced an issue caused by incompatiblity
of AWS SDK and httpcomponents.
> {code}
> java.lang.NoSuchFieldError: INSTANCE
> 	at com.amazonaws.http.conn.SdkConnectionKeepAliveStrategy.getKeepAliveDuration(SdkConnectionKeepAliveStrategy.java:48)
> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:535)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
> 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
> {code}
> The latest AWS SDK depends on 4.3.x which has [DefaultConnectionKeepAliveStrategy.INSTANCE|http://hc.apache.org/httpcomponents-client-4.3.x/httpclient/apidocs/org/apache/http/impl/client/DefaultConnectionKeepAliveStrategy.html#INSTANCE].
This field is introduced from 4.3.
> This will allow us to avoid {{CLASSPATH}} confliction around httpclient versions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message