hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2659) MR-279: ShuffleHandler should use Protocol Buffers for ServiceData
Date Tue, 12 Jul 2011 13:38:59 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13063890#comment-13063890
] 

Robert Joseph Evans commented on MAPREDUCE-2659:
------------------------------------------------

If you don't want it for 0.23 that is fine it can wait.  I have quite a bit done already,
so I will clean up what I have and submit the patch so it is at least a place holder for who
ever picks it up later.  However, this is something that is required to be able claim a maintainable
wire compatibility.  It makes no sense to replace a serialization protocol because of serious
short comings in it so that we can have wire compatibility, but then insert parts of that
old protocol hidden in the new one.

> MR-279: ShuffleHandler should use Protocol Buffers for ServiceData
> ------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2659
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2659
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>             Fix For: 0.23.0
>
>
> Auxiliary Services (Specifically ShuffleHandler) should use ProtocolBuffers for storing/retrieving
data in the ByteBuffer.  Right now there are TODOs to have the format include a version number,
but if we want true wire compatibility we should use the same system we are using elsewhere
in the code for messages, not something invented as we go along.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message