hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6659) Switch RPC to use Avro
Date Tue, 13 Apr 2010 02:59:54 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856284#action_12856284

Sanjay Radia commented on HADOOP-6659:

My viewpoint is in partial agreement with Doug and Eric:
# Implement the pluggable RPC in trunk and it needs to be well tested (agree with Doug)
# Implement the AVRO IDL based protocols in a branch(es). (agree with Eric).
# Only after step 2 do we declare the new protocols to be wire compatible in future. (we are
all in agreement here)
# After step 1, leave the default to be current RPC - but any customer can easily change this
by a config variable. (Disagree with Doug).

There is low risk in #1 as it is pluggable. 
Moving to Avro IDL will change many data types in our servers and cannot be pluggable. This
needs to be well tested (correctness and performance) and cannot cross releases;  hence it
is best done in a branch(es). HDFS and MR can be separate branches; however I don't think
we can split the HDFS protocols as they use many common data types (block-id, block-token,

> Switch RPC to use Avro
> ----------------------
>                 Key: HADOOP-6659
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6659
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: ipc
>            Reporter: Doug Cutting
> This is an umbrella issue for moving HDFS and MapReduce RPC to use Avro.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message