Return-Path: Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: (qmail 6742 invoked from network); 25 Nov 2010 18:37:42 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 25 Nov 2010 18:37:42 -0000 Received: (qmail 80079 invoked by uid 500); 25 Nov 2010 18:37:42 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 79972 invoked by uid 500); 25 Nov 2010 18:37:41 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 79964 invoked by uid 99); 25 Nov 2010 18:37:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Nov 2010 18:37:41 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Nov 2010 18:37:41 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id oAPIbKsu004120 for ; Thu, 25 Nov 2010 18:37:20 GMT Message-ID: <9427387.315931290710240344.JavaMail.jira@thor> Date: Thu, 25 Nov 2010 13:37:20 -0500 (EST) From: "Owen O'Malley (JIRA)" To: common-issues@hadoop.apache.org Subject: [jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12935834#action_12935834 ] Owen O'Malley commented on HADOOP-6685: --------------------------------------- {quote} lack of compromise on this patch {quote} All of the technical feedback for this patch has been addressed, including technical feedback that Tom gave me offline. Making compromises to not change SequenceFile or moving the plugins to the contrib module that would destroy the usability of the patch, isn't really compromise. They are just thinly veiled attempts to make it difficult to use ProtoBufs or Thrift in user's applications. Furthermore, Doug is vetoing this patch based on his personal view about how Hadoop should change direction. Apache doesn't allow dictators and no one is allowed to decide a new direction without discussion and reaching consensus. {quote} posting this patch on such a contentious issue so close to feature freeze of 0.22 {quote} This is a non issue. If you want to fork the current 0.22 branch and become the release manager for it, that is great. If we can make some progress, serialization can got into 0.23 the following month. > Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration > ---------------------------------------------------------------------------------------------------------------------------------- > > Key: HADOOP-6685 > URL: https://issues.apache.org/jira/browse/HADOOP-6685 > Project: Hadoop Common > Issue Type: Improvement > Reporter: Owen O'Malley > Assignee: Owen O'Malley > Fix For: 0.22.0 > > Attachments: libthrift.jar, serial.patch, serial4.patch, serial6.patch, serial7.patch, SerializationAtSummit.pdf > > > Currently, the generic serialization framework uses Map for the serialization specific configuration. Since this data is really internal to the specific serialization, I think we should change it to be an opaque binary blob. This will simplify the interface for defining specific serializations for different contexts (MAPREDUCE-1462). It will also move us toward having serialized objects for Mappers, Reducers, etc (MAPREDUCE-1183). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.