hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7557) Make IPC header be extensible
Date Wed, 12 Oct 2011 18:51:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13126040#comment-13126040

Sanjay Radia commented on HADOOP-7557:

The only extra field added was the protocolKind. Our RPC  headers are not well designed.
ProtocolKind is necessary since the next layer currently supports two different serializations
and can support additional ones.

As far as smaller patch -- that is mostly due to auto generated files from PB. HDFS, since
Todd's data transfer PB stuff, has chosen to commit the PB generated files rather than generate
them via mvn.

If I were to add a new field to the main header (the "hrpc" one) to indicate the format of
the next layer would it satisfy your concerns? It would allow one to write all the layers
in Writables, or PB or Avro.  

> Make  IPC  header be extensible
> -------------------------------
>                 Key: HADOOP-7557
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7557
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Sanjay Radia
>            Assignee: Sanjay Radia
>         Attachments: HADOOP-7557.patch, IpcHeader.proto, ipcHeader1.patch, ipcHeader2.patch

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message