hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2975) IPC server should not allocate a buffer for each request
Date Wed, 04 Jun 2008 00:16:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602126#action_12602126
] 

Hairong Kuang commented on HADOOP-2975:
---------------------------------------

I got a chance to talk to my coworker Ben about object allocation in Java. it seemed we should
not worry too much about the frequent small object allocation since Java does a pretty good
job on this. See http://www-128.ibm.com/developerworks/java/library/j-jtp01274.html. Instead
we should try hard to avoid big object allocation.

> IPC server should not allocate a buffer for each request
> --------------------------------------------------------
>
>                 Key: HADOOP-2975
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2975
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: ipc
>    Affects Versions: 0.16.0
>            Reporter: Hairong Kuang
>         Attachments: Hadoop-2975-v1.patch, Hadoop-2975-v2.patch
>
>
> Currently the IPC server allocates a buffer for each incoming request. The buffer is
thrown away after the request is serialized. This leads to very inefficient heap utilization.
It would be nicer if all requests from one connection could share a same common buffer since
the ipc server has only one request is being read from a socket at a time.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message