hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11339) Reuse buffer for Hadoop RPC
Date Tue, 06 Jan 2015 07:57:35 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265808#comment-14265808

Yi Liu commented on HADOOP-11339:

[~daryn], any updates? Thanks

> Reuse buffer for Hadoop RPC
> ---------------------------
>                 Key: HADOOP-11339
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11339
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: ipc, performance
>            Reporter: Yi Liu
>            Assignee: Yi Liu
> For Hadoop RPCs, we will try to reuse the available connections.
> But when we process each rpc in the same connection, we will allocate a fresh heap byte
buffer to store the rpc bytes data. The rpc message may be very large, i.e., datanode blocks
> There is chance to cause full gc as discussed in HDFS-7435

This message was sent by Atlassian JIRA

View raw message