Return-Path: X-Original-To: apmail-hadoop-general-archive@minotaur.apache.org Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ADC0968A3 for ; Tue, 2 Aug 2011 20:08:21 +0000 (UTC) Received: (qmail 60229 invoked by uid 500); 2 Aug 2011 20:08:20 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 60157 invoked by uid 500); 2 Aug 2011 20:08:19 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 60149 invoked by uid 99); 2 Aug 2011 20:08:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Aug 2011 20:08:19 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL,TO_NO_BRKTS_PCNT X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.210.53] (HELO mail-pz0-f53.google.com) (209.85.210.53) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Aug 2011 20:08:12 +0000 Received: by pzk6 with SMTP id 6so262111pzk.40 for ; Tue, 02 Aug 2011 13:07:51 -0700 (PDT) Received: by 10.68.51.137 with SMTP id k9mr2949064pbo.164.1312315670923; Tue, 02 Aug 2011 13:07:50 -0700 (PDT) Received: from [10.10.10.156] (host1.hortonworks.com [70.35.59.2]) by mx.google.com with ESMTPS id u6sm171471pbh.0.2011.08.02.13.07.49 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 02 Aug 2011 13:07:49 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1082.1) Subject: Re: Hadoop 0.22 update From: Devaraj Das In-Reply-To: Date: Tue, 2 Aug 2011 13:07:48 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <68181C14-A504-40E9-B890-CF3CAB8FBC34@hortonworks.com> References: <41155200-3690-4344-9EA6-6A57F72E19DE@mac.com> To: general@hadoop.apache.org X-Mailer: Apple Mail (2.1082.1) X-Virus-Checked: Checked by ClamAV on apache.org +1 to removing the TaskController code for the 0.22 release. In the MR-279 branch, the security issues identified in MAPREDUCE-2178 = have been taken care of (to my knowledge).=20 On Aug 2, 2011, at 12:58 PM, Eli Collins wrote: > On Tue, Aug 2, 2011 at 12:25 PM, Eli Collins wrote: >> On Tue, Aug 2, 2011 at 12:19 PM, wrote: >>> Having talked to various folks in the community about their = willingness to >>> stabilize and use 0.22 and make it production-quality, here is what = I >>> propose: >>>=20 >>> 1. Cut a release 0.22.0 without mapreduce-2178 patch, with >>> hadoop.security.authentication set to simple (I.e. No = authentication). >>> Make sure that MR-2178 is highlighted as known-issue in the = top-level dir >>> (create a KNOWN-ISSUES.txt ?), and carry out a vote. >>>=20 >>> 2. Later, when MR-2178 patch is committed, cut a release for 0.22.1. = (I >>> have heard of folks working on it, but no date commitments yet.) >>>=20 >>> The reason a 0.22.0 release should happen, IMHO, even without = MR-2178, is >>> that the other components of Hadoop stack (e.g. Pig, hbase, hive = etc) will >>> have a release to test against, and fix any issues for = incompatibility. >>> Also, for folks who do not use kerberos authentication (>90% of the = hadoop >>> users, to my knowledge), it will be a release closest to trunk, with = HDFS >>> appends. Plus, any issues found in the HDFS part of the release = would be >>> directly applicable to the trunk and other future releases. (Not so = about >>> map-reduce, which will undergo major surgery in trunk because of = MR-279.) >>>=20 >>> Thoughts ? >>>=20 >>=20 >> Sounds reasonable to me. #1 is what we did for the 0.21 release. >=20 > Actually, I didn't read close enough. For 0.21 we actually removed the > task tracker, think it makes sense to do that here as well. >=20 > Thanks, > Eli