Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4AAA218A78 for ; Wed, 11 Nov 2015 20:43:47 +0000 (UTC) Received: (qmail 93419 invoked by uid 500); 11 Nov 2015 20:43:45 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 93344 invoked by uid 500); 11 Nov 2015 20:43:45 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 92577 invoked by uid 99); 11 Nov 2015 20:43:45 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Nov 2015 20:43:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id CF88CC1493 for ; Wed, 11 Nov 2015 20:43:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.119 X-Spam-Level: X-Spam-Status: No, score=-0.119 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=altiscale.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id DM_uKEo2F6CZ for ; Wed, 11 Nov 2015 20:43:36 +0000 (UTC) Received: from mail-pa0-f52.google.com (mail-pa0-f52.google.com [209.85.220.52]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id C68F8439F8 for ; Wed, 11 Nov 2015 20:43:35 +0000 (UTC) Received: by pabfh17 with SMTP id fh17so40889264pab.0 for ; Wed, 11 Nov 2015 12:43:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=altiscale.com; s=google; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=uhB++HOd8q8+VVtbrzzcIa0Ku0poKF4Gp/SSdBzuu/g=; b=cGMJ/DdVtTrwLoSK2R8GA09+cS1OFwd3weLrUs/lJ+lIMUMl4EuXwXOaAwX6oLMu/P SYO1/yXDQZpmLyOhlHpCNqKAA4drzczm+TOhxR464xXoC3xpHZXs7xUsaqjm0+VOMWxp 5zCUZSRSzFJ5LX1m9glf2j5ErhXzwIa2dawA0= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:content-transfer-encoding:message-id:references :to; bh=uhB++HOd8q8+VVtbrzzcIa0Ku0poKF4Gp/SSdBzuu/g=; b=mPGMR9k5lQQ+T9JANCTVLhxucFSqrOGvqxBEJCu8JY262pGnbgJAK5MqqRgmJtuaPp +p6Z2WRqQIXXq7KupzFDPlKfmmEab2inn1Wo5eyDZbvjBgWRuPpaUDN6NSvne9ijTe56 ixDp/ZXmaI7eb8cE/ZlS1fiN63oqeI93B6tYBOvP7f6sQ8umJ7YYxq8mylUVhyzAyarw fjIUoXNKlPH44NQ9hX5UgrrSBn5JJLBqfUovsFBchYyvmTgjB0yUNCU73gnX9XbMZ30f zlywDxW6HfE/3tafmoXSGyf+rOO5pEWqXddFfw/NsvAnPNjXE3dRixPni6BOJhpg+CX6 cjJA== X-Gm-Message-State: ALoCoQlmHS3g4ptuM7m6+MMixFImNx7JHgHUTadn9DYfCG57kzefDFBfyfnze0rI+lavyQI/9X1z X-Received: by 10.66.66.166 with SMTP id g6mr17055930pat.152.1447274615144; Wed, 11 Nov 2015 12:43:35 -0800 (PST) Received: from dhcp-206.private.iobm.com (nat.iobm.com. [64.142.69.92]) by smtp.gmail.com with ESMTPSA id tp6sm10895577pbc.81.2015.11.11.12.43.32 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 11 Nov 2015 12:43:33 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.1 \(3096.5\)) Subject: Re: [DISCUSS] Looking to a 2.8.0 release From: Allen Wittenauer In-Reply-To: <0C22896E-D77B-4DE4-99A2-9D81E150779C@hortonworks.com> Date: Wed, 11 Nov 2015 12:43:31 -0800 Cc: Hadoop Common , "yarn-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" , "vinodkv@apache.org" Content-Transfer-Encoding: quoted-printable Message-Id: <3505A424-5B02-49FA-9B56-AF13D20FEABD@altiscale.com> References: <0C22896E-D77B-4DE4-99A2-9D81E150779C@hortonworks.com> To: hdfs-dev@hadoop.apache.org X-Mailer: Apple Mail (2.3096.5) > On Nov 11, 2015, at 12:13 PM, Vinod Vavilapalli = wrote: >=20 > =E2=80=94 HDFS-6200 Create a separate jar for hdfs-client: = Compatible improvement - no dimension of alpha/betaness here. IMO: this feels like a massive break in backwards compatibility. = Anyone who is looking for specific methods in specific jars are going to = have a bad time. Also, it seems as though every week a new issue crops = up that is related to this change. Is Slider still having problems with = it? The reasoning =E2=80=9Cwell, the pom sets the dependencies so = it=E2=80=99s ok=E2=80=9D feels like an *extremely weak* reason this = wasn=E2=80=99t marked incompatible=E2=80=94 it basically makes the = assumption that everyone recompiles for every minor release. > =E2=80=94 Compatibility tools to catch backwards, forwards = compatibility issues at patch submission, release times. Some of it is = captured at YARN-3292. This also involves resurrecting jdiff = (HADOOP-11776/YARN-3426/MAPREDUCE-6310) and/or investing in new tools. There has been talk in the past about adding Java ACC support to = Yetus. > Thoughts? I=E2=80=99d rather see efforts on 3.x than another disastrous = 2.x release. The track record is not good. At least a new major will = signify that danger looms ahead. We=E2=80=99re already treating 2.x = minor releases as effectively major (see the list of incompatible JIRAs) = so what different does it make if we do 2.x vs. 3.x anyway? >=20 > Thanks > +Vinod > PS:As you may have noted above, this time around, I want to do = something that we=E2=80=99ve always wanted to do, but never explicitly = did. I=E2=80=99m calling out readiness of each feature as they stand = today so we can inform our users better of what they can start relying = on in production clusters. =E2=80=A6 except some of these changes are so deep reaching that = even if you don=E2=80=99t use the feature, you=E2=80=99re still impacted = by it ...