hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Walter Su (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8708) DFSClient should ignore dfs.client.retry.policy.enabled for HA proxies
Date Mon, 10 Aug 2015 11:54:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679990#comment-14679990
] 

Walter Su commented on HDFS-8708:
---------------------------------

bq. Current default value is false itself right? and the Retry policy set is TRY_ONCE_THEN_FAIL
by default.
Agree.

bq. DFSClient should ignore dfs.client.retry.policy.enabled for HA proxies
The default value is false for HA. I think it's good enough. But we should not force Client
to ignore dfs.client.retry.policy.enabled.

Assume a situation:
1. Client lost network connection to activeNN somehow. But activeNN works correctly, so no
failover in server side.
2. Then Client failover 15 times(default max retries), and fails.
3. the network issues fixed somehow.
What if user want to retry connecting to activeNN multiple times, and doesn't want to failover
so quickly, user can wait a minute before failover? If so, user can enable this config.

I think we should give user the option. Any ideas?

> DFSClient should ignore dfs.client.retry.policy.enabled for HA proxies
> ----------------------------------------------------------------------
>
>                 Key: HDFS-8708
>                 URL: https://issues.apache.org/jira/browse/HDFS-8708
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Jitendra Nath Pandey
>            Assignee: Brahma Reddy Battula
>            Priority: Critical
>
> DFSClient should ignore dfs.client.retry.policy.enabled for HA proxies to ensure fast
failover. Otherwise, dfsclient retries the NN which is no longer active and delays the failover.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message