hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12658) Lease renewal causes connection flapping
Date Fri, 13 Oct 2017 16:29:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203796#comment-16203796
] 

Daryn Sharp commented on HDFS-12658:
------------------------------------

The logic should be smarter.  A simple improvement may be something hdfsTimeout/2-1000 to
allow the client 1s to issue the renewal.  That should prevent flapping in the majority of
cases.

> Lease renewal causes connection flapping
> ----------------------------------------
>
>                 Key: HDFS-12658
>                 URL: https://issues.apache.org/jira/browse/HDFS-12658
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs-client
>    Affects Versions: 2.0.0-alpha
>            Reporter: Daryn Sharp
>
> Adding a dfsclient to the lease renewer use the minimum of 1/2 the soft timeout vs. 1/2
the client's timeout (when the client closes an idle connection).  Both default to 1m, so
clients with open files that are otherwise not making calls to the NN will experience connection
flapping.  Re-authentication is unnecessarily taxing on the ipc layer.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message