hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2060) DFS client RPCs using protobufs
Date Tue, 02 Aug 2011 18:56:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13078363#comment-13078363
] 

Todd Lipcon commented on HDFS-2060:
-----------------------------------

Yes, the protobuf code is careful to convert endianness where necessary. Re TLB issues, don't
recent versions of Java use HugePages when running on recent Linux that provide transparent
huge page support? That'll increase TLB hit rate significant.

> DFS client RPCs using protobufs
> -------------------------------
>
>                 Key: HDFS-2060
>                 URL: https://issues.apache.org/jira/browse/HDFS-2060
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hdfs-2060-getblocklocations.txt
>
>
> The most important place for wire-compatibility in DFS is between clients and the cluster,
since lockstep upgrade is very difficult and a single client may want to talk to multiple
server versions. So, I'd like to focus this JIRA on making the RPCs between the DFS client
and the NN/DNs wire-compatible using protocol buffer based serialization.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message