hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9011) Support splitting BlockReport of a storage into multiple RPC
Date Thu, 03 Sep 2015 00:01:32 GMT
Jing Zhao created HDFS-9011:
-------------------------------

             Summary: Support splitting BlockReport of a storage into multiple RPC
                 Key: HDFS-9011
                 URL: https://issues.apache.org/jira/browse/HDFS-9011
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Jing Zhao
            Assignee: Jing Zhao


Currently if a DataNode has too many blocks (more than 1m by default), it sends multiple RPC
to the NameNode for the block report, each RPC contains report for a single storage. However,
in practice we've seen sometimes even a single storage can contains large amount of blocks
and the report even exceeds the max RPC data length. It may be helpful to support sending
multiple RPC for the block report of a storage. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message