hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "eric baldeschwieler (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6659) Switch RPC to use Avro
Date Sat, 10 Apr 2010 23:22:49 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855655#action_12855655

eric baldeschwieler commented on HADOOP-6659:

Hi Doug,

Thanks, I think I understand your "branch in place" proposal.  I think you need to understand
my position.  I'm responsible for making sure the hadoop code base is stable enough that we
can run our production work on it.  If we move incrementally as you propose, my customers
will be exposed to a lot of risk and disruption for no return. Yahoo QA staff and developers
will be pulled off what they are working on to complete this project.  That is not how we
want to allocate our resources.

That is why I'm rejecting your current proposal and suggesting that you instead do more work
on an actual branch, including getting the IDL based RPC scheme coded.  Once you build something
that has actual return for my customers, than we will be happy to help with the final debug
and tuning, but first I would like to see you complete the project.  Only then do I want to
see something that effects every single RPC call incorporated into the code base.

I understand that this is not how you would like to proceed and I understand that this is
not historically how you would have proceeded with a project like this in Hadoop.  But, as
Hadoop evolves and the number of business built on it increase, the way we approach radical
change in the code base needs to change as well.  I assert that to proceed with something
as radical as this, you need the consensus of Hadoop committers behind you.  You do not have

Please understand that I am supportive of your desire to incorporate an AVRO based RPC into
Hadoop.  I just feel that you need to take a more cautious approach.  Otherwise you tax the
entire community and I don't support that.


> Switch RPC to use Avro
> ----------------------
>                 Key: HADOOP-6659
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6659
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: ipc
>            Reporter: Doug Cutting
> This is an umbrella issue for moving HDFS and MapReduce RPC to use Avro.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message