hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-10932) Ozone : fix XceiverClient slow shutdown
Date Thu, 29 Sep 2016 22:32:20 GMT
Chen Liang created HDFS-10932:

             Summary: Ozone : fix XceiverClient slow shutdown
                 Key: HDFS-10932
                 URL: https://issues.apache.org/jira/browse/HDFS-10932
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Chen Liang
            Assignee: Chen Liang

Currently {{XceiverClient}} is the underlying entity of {{DistributedStorageHandler.newKeyWriter()}}
and {{DistributedStorageHandler.newKeyReader()}}  for making call to container for read/write.
When {{XceiverClient}} gets closed, {{group.shutdownGracefully()}} gets called, which is an
asynchronous call. 

A problem is that this asynchronous call has default quiet period of 2 seconds before it actually
shutdown, so if we have a burst of read/write calls, we would end up having threads created
faster than they got terminated, reaching system limit at some point.

Ideally, this needs to be fixed with cached clients instead of creating new thread each time.
This JIRA only tries to give a temporary fix for the time being.

Thanks [~anu] for the offline discussion.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

View raw message