Return-Path: X-Original-To: apmail-hadoop-general-archive@minotaur.apache.org Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8604A7281 for ; Wed, 23 Nov 2011 02:18:41 +0000 (UTC) Received: (qmail 21642 invoked by uid 500); 23 Nov 2011 02:18:39 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 21591 invoked by uid 500); 23 Nov 2011 02:18:39 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 21583 invoked by uid 99); 23 Nov 2011 02:18:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Nov 2011 02:18:39 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.213.176 as permitted sender) Received: from [209.85.213.176] (HELO mail-yx0-f176.google.com) (209.85.213.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Nov 2011 02:18:34 +0000 Received: by yenl9 with SMTP id l9so846233yen.35 for ; Tue, 22 Nov 2011 18:18:13 -0800 (PST) Received: by 10.68.20.137 with SMTP id n9mr2101902pbe.40.1322014693106; Tue, 22 Nov 2011 18:18:13 -0800 (PST) MIME-Version: 1.0 Received: by 10.142.230.5 with HTTP; Tue, 22 Nov 2011 18:17:52 -0800 (PST) In-Reply-To: References: <9FE3E432-DB18-4284-BE82-ECF300A2E7B4@hortonworks.com> <4ECB7AD2.2090902@apache.org> From: Harsh J Date: Wed, 23 Nov 2011 07:47:52 +0530 Message-ID: Subject: Re: Un-deprecate 'old' MR apis in branch-0.23 To: general@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 I'm +1 as long as the goal is still to eventually transition to a single, supported API over upcoming releases. We can go over 1:1 guarantees over a JIRA perhaps, to evaluate if any library work still needs to be done. On Wed, Nov 23, 2011 at 3:30 AM, Arun C Murthy wrote: > > On Nov 22, 2011, at 2:34 AM, Steve Loughran wrote: > >> On 22/11/11 02:18, Harsh J wrote: >>> Are gonna be maintaining both APIs forever? >> >> >> That's a key point. Either there are two apis forever or, some time after the new APIs are both a proper superset of the old APIs (are we there yet?) and the majority of downstream project have migrated to the new APIs, then the old ones can be removed. >> >> And how do you persuade developers to move off the old APIs except through deprecation warnings? >> > > It isn't clear, yet, if the new apis are a proper superset of the old APIs i.e. only in 0.21 did they come close to completion (added new Cluster apis etc.). > > As a result, with very little exposure, it's hard to mark them as 'stable' yet. Hence, my proposal to keep the old apis as stable and new one as evolving for hadoop-0.23. > > Furthermore, my personal preference would be to further tweak the new apis along the lines of https://issues.apache.org/jira/browse/MAPREDUCE-1183 before we declare them stable (that has real benefits for Pig/Hive etc.), but that is some way away. > > Arun -- Harsh J