hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-14551) F3A init hangs if you try to connect while the system is offline
Date Tue, 20 Jun 2017 10:05:00 GMT
Steve Loughran created HADOOP-14551:
---------------------------------------

             Summary: F3A init hangs if you try to connect while the system is offline
                 Key: HADOOP-14551
                 URL: https://issues.apache.org/jira/browse/HADOOP-14551
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: 2.9.0
            Reporter: Steve Loughran
            Priority: Minor


F3A init hangs if you try to connect while the system is offline (that is: the nost of the
s3 endpoint is unknown)

Assumption: unknown host exception is considered recoverable & client is spinning for
a long time waiting for it.

I think we can conclude that unknown host is unrecoverable: if DNS is in trouble, you are
doomed.

Proposed: quick lookup of endpoint addr, fail with our wiki diagnostics error on any problem.
I don't see any cost in doing this, as it will guarantee that the endpoint is cached in the
JVM ready for the AWS client connection. If it can't be found, we'll fail within 20+s with
something meaningful.

Noticed during a test run: laptop wifi off; all NICs other than loopback are inactive.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org


Mime
View raw message