hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-10125) no need to process RPC request if the client connection has been dropped
Date Sat, 23 Nov 2013 00:39:35 GMT
Ming Ma created HADOOP-10125:
--------------------------------

             Summary: no need to process RPC request if the client connection has been dropped
                 Key: HADOOP-10125
                 URL: https://issues.apache.org/jira/browse/HADOOP-10125
             Project: Hadoop Common
          Issue Type: Bug
            Reporter: Ming Ma


If the client has dropped the connection before the RPC is processed, RPC server doesn't need
to process the RPC call. We have encountered issues where bad applications can bring down
the NN. https://issues.apache.org/jira/i#browse/Hadoop-9640 tries to address that. When this
occurs, NN's RPC queues are filled up with client requests and DN requests, sometimes we want
to stop the flooding by stopping the bad applications and/or DNs. Some RPC processing like
DatanodeProtocol::blockReport could take couple hundred milliseconds. So it is worthwhile
to have NN skip the RPC calls if DNs have been stopped.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message