hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map<String,String> for configuration
Date Thu, 25 Nov 2010 18:37:20 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12935834#action_12935834
] 

Owen O'Malley commented on HADOOP-6685:
---------------------------------------

{quote}
lack of compromise on this patch
{quote}

All of the technical feedback for this patch has been addressed, including technical feedback
that Tom gave me offline. 

Making compromises to not change SequenceFile or moving the plugins to the contrib module
that would destroy the usability of the patch, isn't really compromise. They are just thinly
veiled attempts to make it difficult to use ProtoBufs or Thrift in user's applications.

Furthermore, Doug is vetoing this patch based on his personal view about how Hadoop should
change direction. Apache doesn't allow dictators and no one is allowed to decide a new direction
without discussion and reaching consensus. 

{quote}
posting this patch on such a contentious issue so close to feature freeze of 0.22
{quote}

This is a non issue. If you want to fork the current 0.22 branch and become the release manager
for it, that is great. If we can make some progress, serialization can got into 0.23 the following
month.

> Change the generic serialization framework API to use serialization-specific bytes instead
of Map<String,String> for configuration
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-6685
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6685
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>             Fix For: 0.22.0
>
>         Attachments: libthrift.jar, serial.patch, serial4.patch, serial6.patch, serial7.patch,
SerializationAtSummit.pdf
>
>
> Currently, the generic serialization framework uses Map<String,String> for the
serialization specific configuration. Since this data is really internal to the specific serialization,
I think we should change it to be an opaque binary blob. This will simplify the interface
for defining specific serializations for different contexts (MAPREDUCE-1462). It will also
move us toward having serialized objects for Mappers, Reducers, etc (MAPREDUCE-1183).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message