From general-return-2535-apmail-hadoop-general-archive=hadoop.apache.org@hadoop.apache.org Tue Dec 14 19:09:33 2010 Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 27903 invoked from network); 14 Dec 2010 19:09:33 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 14 Dec 2010 19:09:33 -0000 Received: (qmail 82768 invoked by uid 500); 14 Dec 2010 19:09:31 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 82650 invoked by uid 500); 14 Dec 2010 19:09:31 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 82642 invoked by uid 99); 14 Dec 2010 19:09:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Dec 2010 19:09:30 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [76.96.62.40] (HELO qmta04.westchester.pa.mail.comcast.net) (76.96.62.40) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Dec 2010 19:09:22 +0000 Received: from omta22.westchester.pa.mail.comcast.net ([76.96.62.73]) by qmta04.westchester.pa.mail.comcast.net with comcast id izLS1f00B1ap0As54792Yf; Tue, 14 Dec 2010 19:09:02 +0000 Received: from [10.72.120.91] ([209.131.62.113]) by omta22.westchester.pa.mail.comcast.net with comcast id j78s1f00P2SbwD53i78vUj; Tue, 14 Dec 2010 19:09:00 +0000 Message-Id: <2C407569-EA1B-4CE9-B584-F81B2DE1D88E@apache.org> From: Owen O'Malley To: general@hadoop.apache.org In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v936) Subject: Re: [VOTE] Direction for Hadoop development Date: Tue, 14 Dec 2010 11:08:51 -0800 References: <4CF433D4.6090407@apache.org> <4CF66812.4080602@apache.org> <4CFD39BC.1080005@apache.org> <4CFD7585.70803@apache.org> <5A920FAB-F76B-4EF7-8740-5698F99A1EC2@gbiv.com> <4CFE6C68.7000503@apache.org> <62FFAEB9-C6E7-4A82-BE1F-5DBB6C0A2CFF@apache.org> <6974FEB1-0E72-4FBF-8196-BF4B4E4D77BC@apache.org> X-Mailer: Apple Mail (2.936) On Dec 13, 2010, at 11:14 PM, Eric Sammer wrote: > - Codify (by vote) whether design plans are required or if an > informal email > indicating intent is sufficient, and under what circumstances. Provide > examples to clarify circumstances. Solves the long term but not > HADOOP-6685. We had a presentation about my plans for this jira in June and both Tom and Doug attended and asked questions. It wasn't a lack of communication. At that time, they didn't like the proposal but didn't plan to block it. In general code changes shouldn't require a vote. The goal is to work together as a community to produce code, not make everything a lawyerly argument. > Owen, would you be amenable to working to find a way to remove the > PB dep in > support of HADOOP-6685 and handling bootstrapping with either one of > the > existing deps or simple hard coded length, type, value serialization / > deserialization similar to Writables? Of course it is possible, but it is a far worse engineering solution. ProtocolBuffers do exactly what I need, it is foolish to implement an hand-crafted replacement. My point is that a dependence on Avro was accepted without issue. No one had an issue when I added snakeyaml. All of the objections are fundamentally based in a dislike of serializations other than Yarn. -- Owen