hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6659) Switch RPC to use Avro
Date Tue, 13 Apr 2010 02:59:54 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856284#action_12856284
] 

Sanjay Radia commented on HADOOP-6659:
--------------------------------------

My viewpoint is in partial agreement with Doug and Eric:
# Implement the pluggable RPC in trunk and it needs to be well tested (agree with Doug)
# Implement the AVRO IDL based protocols in a branch(es). (agree with Eric).
# Only after step 2 do we declare the new protocols to be wire compatible in future. (we are
all in agreement here)
# After step 1, leave the default to be current RPC - but any customer can easily change this
by a config variable. (Disagree with Doug).

There is low risk in #1 as it is pluggable. 
Moving to Avro IDL will change many data types in our servers and cannot be pluggable. This
needs to be well tested (correctness and performance) and cannot cross releases;  hence it
is best done in a branch(es). HDFS and MR can be separate branches; however I don't think
we can split the HDFS protocols as they use many common data types (block-id, block-token,
etc). 


> Switch RPC to use Avro
> ----------------------
>
>                 Key: HADOOP-6659
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6659
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: ipc
>            Reporter: Doug Cutting
>
> This is an umbrella issue for moving HDFS and MapReduce RPC to use Avro.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message