hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7557) Make IPC and RPC headers be extensible
Date Thu, 08 Sep 2011 17:47:09 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13100490#comment-13100490

Doug Cutting commented on HADOOP-7557:

Protocol buffers are a lot more than just that.  If that's all that's required, then the protocol
specification can define constants for these, e.g.:

  [16-bit key] [16-bit value_length] [value]

A particular key constant can be reserved for "dynamic" parameters, e.g.,
  [ key=OTHER] [ 16-bit payload_length] [16-bit key_length] [key] [value]

(The length of the value is payload_length - key_length.)

A "dynamic" parameter that's used a lot could get incorporated into the next version of the
protocol specification.

I also question whether the size of RPC headers is a significant factor in Hadoop performance.
 Even when the payload is only a few bytes, the dominant cost is not network bandwidth nor
request parsing.

> Make  IPC and RPC headers be extensible
> ---------------------------------------
>                 Key: HADOOP-7557
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7557
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Sanjay Radia

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message