From dev-return-5548-archive-asf-public=cust-asf.ponee.io@airflow.incubator.apache.org Tue Jul 10 20:50:50 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 576FD180634 for ; Tue, 10 Jul 2018 20:50:50 +0200 (CEST) Received: (qmail 45051 invoked by uid 500); 10 Jul 2018 18:50:44 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 45032 invoked by uid 99); 10 Jul 2018 18:50:43 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Jul 2018 18:50:43 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 3DD441A2998 for ; Tue, 10 Jul 2018 18:50:43 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.131 X-Spam-Level: X-Spam-Status: No, score=-0.131 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 34Ji1VHeMP8K for ; Tue, 10 Jul 2018 18:50:42 +0000 (UTC) Received: from mail-wm0-f53.google.com (mail-wm0-f53.google.com [74.125.82.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id EA5385F11F for ; Tue, 10 Jul 2018 18:50:41 +0000 (UTC) Received: by mail-wm0-f53.google.com with SMTP id w16-v6so68513wmc.2 for ; Tue, 10 Jul 2018 11:50:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=7WA8xLzozGHg2lmhTy93aBTdgX4oJAnKGdEPgownIWk=; b=npipdOFtgfQTlJKK4bn1KORvxB/2HZYwwNgTaDnRyVC08a4FidxkW05o3plfQZd33l U1d+ICEYW2l2+iaHkNaLDGD1Pr/myyGlyJuMHtGcx4Mf9FlzwGxVfdlzNGvK+gNMPFix XNHelKb2PlIo+BtmJqNX9yrZQH89S8OiPqFobysekDI4o0JlaMK9Ty7jTGW95lb+Ic9z uAZA8CiahaSLEION0ntFCzz1DcHRMlDo0UABJAbKgAo8qZVmHue5p4rHIk4/5uJiUUIi ncefFkrX/FaXXL5a3k1jB4cTQdycBwrEqGE4FukkcLTMJI31SPxt0YvrLEUPQ/AOiD9n Y3GA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=7WA8xLzozGHg2lmhTy93aBTdgX4oJAnKGdEPgownIWk=; b=rrm5nWd6nHMtT+zxNopx3M+9pykXrwHG0Jm18wYCfAn9gZAVGxzKAdFxzg3UMP7xOF vx7Grg7fwdORZE76o/i6tul2q0zQPPyDCUIZ1LvKfb5ZonP3j2vss3h6RdMkg2SyWrMb E96oDihJWm67H/gGGGj8z6Hz90FW6Vn2NiieWYV5WGmV4vfv5X1smdN6GIkh20HKAa6L h9ax39Ww6cKeTmvY3U6kOD61NNZsDfStipBUN43ifbe7EhVGU4dR6+ZdaXYfnTQnjZa2 nezu01gZLzBw4K3gsQIC/Z2fc4maTdUhkNUZ45fO755mImAnSGIauAGGyfJOw9B80dHc u4/w== X-Gm-Message-State: APt69E0lVrhzX6YfJc13fRmNlSc1jEPXn95P8A5Gr1fO2pQ9mFpmYy0A F+2FH7zDiF2CsBUSakc38pqBEUnWFXBAOSn4FawMjw== X-Google-Smtp-Source: AAOMgpcEWJB1J/oqmhOBXmz+u6A8Y38Hk2Avu/NYr6hdpAv1kTQjwDfszSSPELLftZsYtmBXXyJu+m2u8AdozJCYvZ8= X-Received: by 2002:a1c:b004:: with SMTP id z4-v6mr16625447wme.70.1531248641365; Tue, 10 Jul 2018 11:50:41 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a1c:4c16:0:0:0:0:0 with HTTP; Tue, 10 Jul 2018 11:50:00 -0700 (PDT) From: Jakob Homan Date: Tue, 10 Jul 2018 11:50:00 -0700 Message-ID: Subject: [DISCUSS] AIP - Time for Airflow Improvement Proposals? To: dev@airflow.incubator.apache.org Content-Type: text/plain; charset="UTF-8" Lots of Apache projects use ?IPs - Whatever Improvement Proposal - to document and gather consensus on large changes to the code base. Some examples: * Kafka Improvement Proposals (KIP) - https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals * Flink Improvement Proposal (FLIP) - https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals * Spark Improvement Proposal (SPIP) - https://spark.apache.org/improvement-proposals.html We've got a few changes that have been discussed, either on the list/JIRA (good) or in private (bad - https://incubator.apache.org/guides/committer.html#mailing_lists) that are of a magnitude that they may benefit from some version of this process. Examples: * The in-progress plan to refactor out connectors and hooks (AIRFLOW-2732) * K8S deployment operator proposal * Initial Design for Supporting fine-grained Connection encryption The benefits of this approach is that the design is hosted somewhere less ephemeral and more editable than email. It also provides a framework for documenting and confirming consensus through the whole community. What do y'all think? -Jakob