hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bibin A Chundatt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time
Date Thu, 10 May 2018 11:59:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470293#comment-16470293

Bibin A Chundatt commented on HDFS-13388:

Since HDFS-12813 is long back closed might need a backport jira . I am ok with you filing
jira too.

> RequestHedgingProxyProvider calls multiple configured NNs all the time
> ----------------------------------------------------------------------
>                 Key: HDFS-13388
>                 URL: https://issues.apache.org/jira/browse/HDFS-13388
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs-client
>            Reporter: Jinglun
>            Assignee: Jinglun
>            Priority: Major
>             Fix For: 3.2.0, 3.1.1, 3.0.3
>         Attachments: HADOOP-13388.0001.patch, HADOOP-13388.0002.patch, HADOOP-13388.0003.patch,
HADOOP-13388.0004.patch, HADOOP-13388.0005.patch, HADOOP-13388.0006.patch, HADOOP-13388.0007.patch,
HADOOP-13388.0008.patch, HADOOP-13388.0009.patch, HADOOP-13388.0010.patch, HADOOP-13388.0011.patch,
HADOOP-13388.0012.patch, HADOOP-13388.0013.patch, HADOOP-13388.0014.patch
> In HDFS-7858 RequestHedgingProxyProvider was designed to "first simultaneously call multiple
configured NNs to decide which is the active Namenode and then for subsequent calls it will
invoke the previously successful NN ." But the current code call multiple configured NNs every
time even when we already got the successful NN. 
>  That's because in RetryInvocationHandler.java, ProxyDescriptor's member proxyInfo is
assigned only when it is constructed or when failover occurs. RequestHedgingProxyProvider.currentUsedProxy
is null in both cases, so the only proxy we can get is always a dynamic proxy handled by RequestHedgingInvocationHandler.class. RequestHedgingInvocationHandler.class
handles invoked method by calling multiple configured NNs.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message