hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-11339) Reuse buffer for Hadoop RPC
Date Wed, 26 Nov 2014 03:49:12 GMT
Yi Liu created HADOOP-11339:

             Summary: Reuse buffer for Hadoop RPC
                 Key: HADOOP-11339
                 URL: https://issues.apache.org/jira/browse/HADOOP-11339
             Project: Hadoop Common
          Issue Type: Improvement
          Components: ipc, performance
            Reporter: Yi Liu
            Assignee: Yi Liu

For Hadoop RPCs, we will try to reuse the available connections.
But when we process each rpc in the same connection, we will allocate a fresh heap byte buffer
to store the rpc bytes data. The rpc message may be very large, i.e., datanode blocks report.

There is chance to cause full gc as discussed in HDFS-7435

This message was sent by Atlassian JIRA

View raw message