hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map<String,String> for configuration
Date Mon, 29 Nov 2010 17:09:23 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12964830#action_12964830
] 

Doug Cutting commented on HADOOP-6685:
--------------------------------------

Chris> The existential question of the scope of Hadoop needs to be answered by the PMC,
not navigated by vetoes.

Our  processes do not include setting of an official project direction.  We consider patches
and proposals that are submitted.  We must reach consensus on each issue before it can be
committed.  Vetos are a last resort when no mutually acceptable compromise can be found. 
That's the process.

Chris>  Tom, Doug: if you're willing to drop conditions to your vetoes on all but the protocol
buffers vs JSON [ ... ]

I'm not clear on what you're proposing here, but I am in general open to discussion of potential
compromises.  If you feel the project requires some new functionality that it is not feasible
to implement outside of this project, you might outline in more detail what the patch you
propose would include.

> Change the generic serialization framework API to use serialization-specific bytes instead
of Map<String,String> for configuration
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-6685
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6685
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>             Fix For: 0.22.0
>
>         Attachments: libthrift.jar, serial.patch, serial4.patch, serial6.patch, serial7.patch,
SerializationAtSummit.pdf
>
>
> Currently, the generic serialization framework uses Map<String,String> for the
serialization specific configuration. Since this data is really internal to the specific serialization,
I think we should change it to be an opaque binary blob. This will simplify the interface
for defining specific serializations for different contexts (MAPREDUCE-1462). It will also
move us toward having serialized objects for Mappers, Reducers, etc (MAPREDUCE-1183).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message