Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 68033200C6E for ; Mon, 8 May 2017 13:07:53 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 668BC160BA5; Mon, 8 May 2017 11:07:53 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 8542A160B99 for ; Mon, 8 May 2017 13:07:52 +0200 (CEST) Received: (qmail 99578 invoked by uid 500); 8 May 2017 11:07:51 -0000 Mailing-List: contact dev-help@brooklyn.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@brooklyn.apache.org Delivered-To: mailing list dev@brooklyn.apache.org Received: (qmail 99565 invoked by uid 99); 8 May 2017 11:07:51 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 May 2017 11:07:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id C1A98CA95D for ; Mon, 8 May 2017 11:07:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.397 X-Spam-Level: X-Spam-Status: No, score=-0.397 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.796, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=cloudsoftcorp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 8G9rFUfxLpqU for ; Mon, 8 May 2017 11:07:48 +0000 (UTC) Received: from mail-wr0-f172.google.com (mail-wr0-f172.google.com [209.85.128.172]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 38FC65F568 for ; Mon, 8 May 2017 11:07:48 +0000 (UTC) Received: by mail-wr0-f172.google.com with SMTP id l9so40489048wre.1 for ; Mon, 08 May 2017 04:07:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudsoftcorp.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=0T4QKnefbvAwShazPxJJZUwnNZYsf4otJg7mqRct3sk=; b=N4mIZTOlpsq7pNNe4/Ee1nUXiVJD9Ichv9292SGeiYcHEgnkCibG7FPQ8JyiLpjjFT ZoZ8n8h9GVZg/oOtA6RfbIqbEi+e7H/s/9yH4bD+6hZCCpSVKi+NNol5+TM1xP2yEx5f n/CzoLqNDjipEj4YDuqqiY3fFbh0GsE5pro2M= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=0T4QKnefbvAwShazPxJJZUwnNZYsf4otJg7mqRct3sk=; b=qspgOcGZ+D8t7rHg+kNfmTG5CJlNrFRpArKKjnBTSxjQuAvWTxq+HlaKcwWoN6WiHs 68Y/H7D9BoHPIOXmLZApv33QjJWdRzkxEbiBL7Gbcvj3P5ty9N5jR+rIB/ADoCDj+DJK pLgPOoywNiuV8k9RIojUgHdthDjojq2AvKroFdrtL7jmQRDhvsGMUu+6cCMz8x4q27lk Fh76qbNlqnhAVbVDdzXuH1AgNwvqzzETXlUl/gadFnQuC8e56XlWODaVtMEj+SRT/rd2 5eeoJjOTciB1UAJvgz0gaChZqQqFhASXMhkDkI3ruXgi7heR32bv1GOzqa+APYOkRbFd BagQ== X-Gm-Message-State: AODbwcA0qoto8L+MqBYGdvildwykcbewERlGr9dotb6LWm17MGIJ3AsE LRC0Is6if5dZq9SBzNpCONw0O4QsKpzX9u35fE/bzsgsCrkpYCxFPv62M9zAdKYkFPqaUfwZ+mB ujkXppirzZc67j/b8zg== X-Received: by 10.46.8.26 with SMTP id 26mr5872105lji.128.1494241662525; Mon, 08 May 2017 04:07:42 -0700 (PDT) MIME-Version: 1.0 Received: by 10.25.209.141 with HTTP; Mon, 8 May 2017 04:07:42 -0700 (PDT) In-Reply-To: References: From: Duncan Godwin Date: Mon, 8 May 2017 12:07:42 +0100 Message-ID: Subject: Re: [VOTE] New standards for PR reviewing. To: dev@brooklyn.apache.org Content-Type: multipart/alternative; boundary=f403045ec2da80faf1054f013fba X-Legal-Virus-Advice: Whilst all reasonable care has been taken to avoid the transmission of viruses, it is the responsibility of the recipient to ensure that the onward transmission, opening or use of this message and any attachments will not adversely affect its systems or data. No responsibility is accepted by Cloudsoft Corporation Limited in this regard and the recipient should carry out such virus and other checks as it considers appropriate. X-Legal-Confidentiality: This e-mail message is confidential and for use by the addressee only. If the message is received by anyone other than the addressee, please return the message to the sender by replying to it and then delete the message from your computer. Internet e-mails are not necessarily secure. Cloudsoft Corporation Limited does not accept responsibility for changes made to this message after it was sent. X-Legal-Company-Info: Cloudsoft Corporation Limited. Registered in Scotland. Number: SC349230. Registered Office: 13 Dryden Place, Edinburgh, EH9 1RP. archived-at: Mon, 08 May 2017 11:07:53 -0000 --f403045ec2da80faf1054f013fba Content-Type: text/plain; charset=UTF-8 +1 (binding) On 8 May 2017 at 12:04, Geoff Macartney wrote: > +1 (binding) > > On Mon, 8 May 2017 at 11:56 Robert Moss wrote: > > > +1 > > > > On 8 May 2017 at 11:55, Richard Downer wrote: > > > > > +1 (binding) > > > > > > > > > On 8 May 2017 at 11:55, Richard Downer wrote: > > > > > > > There have been recent discussions about how the committers assess > PRs > > > for > > > > merging. The discussion is summarised below and the original thread > > > > available at [1]. > > > > > > > > The consensus of the discussion is to adopt new standards for > > committers > > > > reviewing PRs, as follows: > > > > > > > > ------ > > > > > > > > If a PR has not been reviewed within a certain amount of time - > > suggested > > > > to be 7 days, or less for smaller PRs - nor has a committer indicated > > > that > > > > they are doing a detailed review, then the PR shall be considered > for a > > > > less detailed review, an "eyeball test". > > > > > > > > Under an eyeball test, a reviewer will consider if the PR is: > > > > * clearly helpful & not obviously wrong > > > > * low-risk / doesn't break compatibility > > > > * good test coverage (and passing) > > > > * likely to be maintained > > > > > > > > If it passes the above criteria, then the reviewer will add a comment > > to > > > > the PR, and ask if further review is appropriate, possibly tagging > > > specific > > > > committers who may be interested. Then if there is no objection > within > > 72 > > > > hours, passive consensus should be assumed, and the PR merged. > > > > > > > > If the PR does not pass the above criteria, the reviewer should say > > what > > > > they have doubts about, suggest what the contributor could do to > help, > > > > and/or appeal to other committers more familiar with an area. If > > > > appropriate, move from GitHub onto the mailing list. (The aim here is > > to > > > > get a discussion going and not give the contributor the impression > > their > > > PR > > > > is being ignored.) > > > > > > > > ------ > > > > > > > > This vote is to decide if we wish to adopt these standards for all PR > > > > reviews going forward, and to document these standards in our > website. > > > > > > > > This vote will be open for a minimum of 72 hours. > > > > > > > > [ ] +1 - adopt this standard > > > > [ ] 0 - no opinion > > > > [ ] -1 - do not adopt this standard, because: > > > > > > > > ------ > > > > > > > > Background: > > > > > > > > This is related to the recent thread at [1]. > > > > > > > > Traditionally, this project has had a high bar for reviewing > > > contributions > > > > prior to merging. This dates back to the project's inception, before > it > > > was > > > > part of Apache. Reviewers would be expected to inspect the code and > > > > personally test it before allowing it to be merged. > > > > > > > > There has been concern expressed that this is holding back Brooklyn > > > > development. Reviewing a PR can be time-consuming; often a detailed > > > review > > > > requires expert knowledge in a particular area of the code which only > > > some > > > > committers possess. The result is that PRs, especially larger ones or > > > ones > > > > in core areas of the project, do not receive timely review, and in > some > > > > cases languish far too long. This is bad for the project as it holds > > back > > > > our velocity, and frustrates contributors who see their changes stuck > > in > > > > the system for extended lengths of time. > > > > > > > > Since we joined the ASF, we have had feedback from others with > > experience > > > > in Apache that we are too conservative with our code review > > requirements. > > > > We also recognise the value in automated testing to catch regressions > > > > (although these constantly need work, of course), and in our Git > source > > > > control to enable us to revert changes that turn out to be > particularly > > > > problematic. We can relax our strict reviewing requirements, which > will > > > > increase our velocity, and show our contributors that their work is > > > > receiving attention and getting merged. Should a merge prove to be > > > > problematic, their is still opportunity to do a bug fix (and get it > > > merged > > > > under the same fast process, too), and ultimately the chance to > > "revert" > > > > the merge if necessary. > > > > > > > > So we believe that the quality of the finished product will not be > > > > adversely affected by these changes. > > > > > > > > > > > > [1]https://lists.apache.org/thread.html/ > 4398448fd548495a5159016a97afa1 > > > > 2dd787ab34786b3bbc0881d5b4@%3Cdev.brooklyn.apache.org%3E > > > > > > > > Thanks > > > > Richard. > > > > > > > > > > > > > > --f403045ec2da80faf1054f013fba--