Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 7714A200B66 for ; Thu, 18 Aug 2016 18:12:47 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7591F160A86; Thu, 18 Aug 2016 16:12:47 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id BC031160AAE for ; Thu, 18 Aug 2016 18:12:46 +0200 (CEST) Received: (qmail 93501 invoked by uid 500); 18 Aug 2016 16:12:44 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 93450 invoked by uid 99); 18 Aug 2016 16:12:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2016 16:12:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id AD401C0439; Thu, 18 Aug 2016 16:12:43 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id tSdTjzTjvpbj; Thu, 18 Aug 2016 16:12:41 +0000 (UTC) Received: from mail-it0-f48.google.com (mail-it0-f48.google.com [209.85.214.48]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 925E85F5A1; Thu, 18 Aug 2016 16:12:40 +0000 (UTC) Received: by mail-it0-f48.google.com with SMTP id x131so2311926ite.0; Thu, 18 Aug 2016 09:12:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=TtYBii45BYBjXelYA7YLMMsjjXGhqiTx+oFEQq8MZtQ=; b=QgjpJ4rx2hN+rWVDY91zfKPcXXkCgYTlX+iW3KY5dad9CmTJ+uXkSRtWP0UsAsO5K+ zuqyDBGhEPNvK8t4AZDzbIX8ZfP1lnwyWwtYMXaIBb8EMSNIw3pE3220OgBKkkuGhtTx qn4VncqAzOWrjtRF5Nss77qP180d1Lzp4v67DZoI6Z61AUFvLEg6zszixlwp/RFZgPir di8uACR7jsbaiPdXZ2M2gP95Kwl9YkgMhKsyfz0geR1poi6xAXA5j5VNJ8AD5e7kngcm GheqKGN/1aFpEeq5b2BY9XQpaMNkrEmU0rkWE5pWWMvIytO29tokWYwMwnKk1pCFoKxt YPAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=TtYBii45BYBjXelYA7YLMMsjjXGhqiTx+oFEQq8MZtQ=; b=EYKRCI6lSXY7K3XuxS1sIDYust/56XmnDAAYzFAPbTBjeweMjVfZ9s7Q9BBGhGfop3 95hL5fiDvMqQpL46HORyH0szzSOGH/vDEHSf/FANVnUYkI/b45nMl4PqFAWDU0ngpi/9 GWuo0tvKslPZZgALTZyljqxhpRRvPmap32Jpo7ej6DAwq9K1uSa33LCWmLyRX0lyidFm hlAMQqjaWB5e9/hjbnWZINpqAGNJhpgZgpOcvTMSGoEEDr1/cVHfz0uJSPdHHo4rkAsO F0ReWb9hkfnGF/E+RDAQBZ5qvdczES72+kB3abvDPSlw0TO3GhbogXwfMEj1EMpDJc08 SlTQ== X-Gm-Message-State: AEkoouu8DBchy8RlfWMAQAnQuw+nJ08I1xV8LR4CZqezhKVj17TIWA61ZiQOQTWBjIW9ls9Q89ePd/NohA0GEg== X-Received: by 10.36.33.197 with SMTP id e188mr487142ita.42.1471536759457; Thu, 18 Aug 2016 09:12:39 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.75.199 with HTTP; Thu, 18 Aug 2016 09:12:38 -0700 (PDT) In-Reply-To: <0E3EC187-44C6-4B95-B8CD-9E22034B7A71@hortonworks.com> References: <732DB60A-844D-4FA3-822B-08DB587DEB9B@apache.org> <6192A234-0F2E-4CB4-B3C7-142728E0800A@effectivemachines.com> <1471528833445.31857@hortonworks.com> <0E3EC187-44C6-4B95-B8CD-9E22034B7A71@hortonworks.com> From: larry mccay Date: Thu, 18 Aug 2016 12:12:38 -0400 Message-ID: Subject: Re: [VOTE] Release Apache Hadoop 2.7.3 RC1 To: Steve Loughran Cc: Junping Du , Vinod Kumar Vavilapalli , Allen Wittenauer , "common-dev@hadoop.apache.org" , "hdfs-dev@hadoop.apache.org" , "yarn-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a1146ec4ed24f11053a5ad9c6 archived-at: Thu, 18 Aug 2016 16:12:47 -0000 --001a1146ec4ed24f11053a5ad9c6 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I believe it was described as some previous audit entries have been superseded by new ones and that the order may no longer be the same for other entries. For what it=E2=80=99s worth, I agree with the assertion that this is a back= ward incompatible output - especially for audit logs. On Thu, Aug 18, 2016 at 11:32 AM, Steve Loughran wrote: > > > On 18 Aug 2016, at 14:57, Junping Du wrote: > > > > I think Allen's previous comments are very misleading. > > In my understanding, only incompatible API (RPC, CLIs, WebService, etc.= ) > shouldn't land on branch-2, but other incompatible behaviors (logs, > audit-log, daemon's restart, etc.) should get flexible for landing. > Otherwise, how could 52 issues ( https://s.apache.org/xJk5) marked with > incompatible-changes could get landed on branch-2 after 2.2.0 release? Mo= st > of them are already released. > > > > Thanks, > > > > Junping > > > Don't get AW started on compatiblity; it'll only upset him. > > One thing he does care about is the ability of programs to consume the > output of commands and logs =E2=80=94and for that even the output of comm= ands and > logs need to continue to be parseable > > https://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/ > Compatibility.html#Command_Line_Interface_CLI > > " Changing the path of a command, removing or renaming command line > options, the order of arguments, or the command return code and output > break compatibility and may adversely affect users." > > I believe Allen is particularly concerned that a minor point release is > going in as incompatible, on the basis the audit log output will change > =E2=80=94that's the log that is explicitly designed for machine processin= g, hooking > up to flume & kafka, etc. As example, Spotify spoke at a Hadoop Summit > conference about how they used it to identify files which hadn't been use= d > for a long time; inferring an atime attribute from the access history. > > What has changed in the output? > > --------------------------------------------------------------------- > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org > For additional commands, e-mail: common-dev-help@hadoop.apache.org > > --001a1146ec4ed24f11053a5ad9c6--