hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-11339) Reuse buffer for Hadoop RPC
Date Wed, 26 Nov 2014 03:49:12 GMT
Yi Liu created HADOOP-11339:
-------------------------------

             Summary: Reuse buffer for Hadoop RPC
                 Key: HADOOP-11339
                 URL: https://issues.apache.org/jira/browse/HADOOP-11339
             Project: Hadoop Common
          Issue Type: Improvement
          Components: ipc, performance
            Reporter: Yi Liu
            Assignee: Yi Liu


For Hadoop RPCs, we will try to reuse the available connections.
But when we process each rpc in the same connection, we will allocate a fresh heap byte buffer
to store the rpc bytes data. The rpc message may be very large, i.e., datanode blocks report.


There is chance to cause full gc as discussed in HDFS-7435



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message