hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13973) S3 requests failing: java.lang.IllegalStateException: Connection is not open
Date Wed, 11 Jan 2017 12:52:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15818235#comment-15818235
] 

Steve Loughran commented on HADOOP-13973:
-----------------------------------------

Stack 2: GET
{code}
 java.lang.IllegalStateException: Connection is not open
        at org.apache.http.util.Asserts.check(Asserts.java:34)
        at org.apache.http.impl.SocketHttpClientConnection.assertOpen(SocketHttpClientConnection.java:75)
        at org.apache.http.impl.AbstractHttpClientConnection.sendRequestHeader(AbstractHttpClientConnection.java:253)
        at org.apache.http.impl.conn.DefaultClientConnection.sendRequestHeader(DefaultClientConnection.java:278)
        at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestHeader(ManagedClientConnectionImpl.java:223)
        at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:204)
        at com.amazonaws.http.protocol.SdkHttpRequestExecutor.doSendRequest(SdkHttpRequestExecutor.java:47)
        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
        at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:686)
        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:488)
        at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:884)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:728)
        at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785)
        at com.amazonaws.services.s3.AmazonS3Client.getObject(AmazonS3Client.java:1191)
        at org.apache.hadoop.fs.s3a.S3AInputStream.reopen(S3AInputStream.java:148)
        at org.apache.hadoop.fs.s3a.S3AInputStream.lazySeek(S3AInputStream.java:281)
        at org.apache.hadoop.fs.s3a.S3AInputStream.read(S3AInputStream.java:364)
        at org.apache.hadoop.fs.s3a.S3AInputStream.readFully(S3AInputStream.java:579)
        at org.apache.hadoop.fs.FSDataInputStream.readFully(FSDataInputStream.java:111)
        at org.apache.orc.impl.ReaderImpl.extractFileTail(ReaderImpl.java:501)
        at org.apache.orc.impl.ReaderImpl.<init>(ReaderImpl.java:369)
        at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:62)
        at org.apache.hadoop.hive.ql.io.orc.encoded.ReaderImpl.<init>(ReaderImpl.java:32)
        at org.apache.hadoop.hive.ql.io.orc.encoded.EncodedOrcFile.createReader(EncodedOrcFile.java:28)
{code}

> S3 requests failing: java.lang.IllegalStateException: Connection is not open
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-13973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13973
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0
>         Environment: EC2 cluster
>            Reporter: Rajesh Balamohan
>            Assignee: Steve Loughran
>             Fix For: 2.8.0
>
>
> S3 requests failing with an error coming from Http client, "java.lang.IllegalStateException:
Connection is not open"
> Some online discussion implies that this is related to shared connection pool shutdown
& fixed in http client 4.4+. Hadoop & AWS SDK use v 4.5.2 so the fix is in, we just
need to make sure the pool is being set up right.
> There's a problem here of course: it may require moving to a later version of the AWS
SDK, with the consequences on jackson &c, as seen in HADOOP-13050. And that's if there
is a patched version out there



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message