Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 90C99200D24 for ; Tue, 10 Oct 2017 02:05:37 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 8F3EC1609E0; Tue, 10 Oct 2017 00:05:37 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D55291609CE for ; Tue, 10 Oct 2017 02:05:36 +0200 (CEST) Received: (qmail 1984 invoked by uid 500); 10 Oct 2017 00:05:36 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Received: (qmail 1968 invoked by uid 99); 10 Oct 2017 00:05:35 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Oct 2017 00:05:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id E1838D6F17 for ; Tue, 10 Oct 2017 00:05:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 3RUe_Rl5D5H5 for ; Tue, 10 Oct 2017 00:05:34 +0000 (UTC) Received: from mail-wm0-f54.google.com (mail-wm0-f54.google.com [74.125.82.54]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id C3D1C5FD41 for ; Tue, 10 Oct 2017 00:05:33 +0000 (UTC) Received: by mail-wm0-f54.google.com with SMTP id u138so580114wmu.5 for ; Mon, 09 Oct 2017 17:05:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=OqY+AndWjxxXv2KTFiuRZEL+U+CCYRzDO/179GQqFeo=; b=VsrBpwvZ3zWMjQFQMmJBh6am/PhaW4hh7zL//tBAmr71EtkFbWzBBDlRslHzmmhADF FJOsfEym68fjjRAuf5lgbWF2osVJ12z1p20zYcluh6abr68r1/5CYkVuhLlIQvYMgF1A twM/pgPf3IlrKY1+b4aKgSN6Bx3nD14FvvFHaKz3AlHA8SFtMAjxq6BdP1D5xWK3NyvK oZ/FBDpIYpI2AYsUTvvoP3ur03AVQdhHpqpTxONOVdkzz8szNYJzX9it8HhsO2nG4udA gTLXzC+89c2LCQKEGqVTmuyqBd2lDTygnbCmWV9rlSZ21qv4tO7dDaIdQOmN+VGy+aNL MGlg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=OqY+AndWjxxXv2KTFiuRZEL+U+CCYRzDO/179GQqFeo=; b=ECdmni0KNUXL+ZyV4Una+ZKEfsaLTiVCYI9CLSAF9hP6EiMruIzzZiVSTL1MqoCPXL 97BHPPyF7xCtKvf7itVsLiRmEuIsiGiST2F5by0FDyjir4GQaYSYiEOw7dsjwq/GZqW+ BmthnUvGDnAR7YoDeTJvzl2rgK9AJiscjMTBW6u0OtlNnXkS1ED/MLPCI5OGfg3vZBrU wDhz+IlDoOYDQAylGCyJ9oJCQ968PeMYRjWCz5iRmg0zFHnzqWnHS3mAVdHK4ai4kGJh JkDfc8mTwPxODesVJcjc6u6dGGF0jiUL8wwc2WkkGy4fOGlarImuPr8V5oZ8CFD9PXyK f+eA== X-Gm-Message-State: AMCzsaWVHt9XbCZPZEuwBkvwX2DNyR5DemD/K/9D4leszYoJ6cwtGqhK Q6Xb/fEDVN95geoQ7uYb1vs8QFxHh4RrTYBWQWfN0Q== X-Google-Smtp-Source: AOwi7QDwhPtr81tc++58tQUGymSkszRPgyRQrjph14WbfS2jdy8AV4ui1+nT6bn8oYLUu/vTza2ZkGkv75JWulG2YHg= X-Received: by 10.223.147.39 with SMTP id 36mr10190926wro.175.1507593932394; Mon, 09 Oct 2017 17:05:32 -0700 (PDT) MIME-Version: 1.0 From: Indhu Date: Tue, 10 Oct 2017 00:05:21 +0000 Message-ID: Subject: Incremental builds To: "dev@mxnet.incubator.apache.org" Content-Type: multipart/alternative; boundary="94eb2c0d22e6ce564a055b261039" archived-at: Tue, 10 Oct 2017 00:05:37 -0000 --94eb2c0d22e6ce564a055b261039 Content-Type: text/plain; charset="UTF-8" Hi, We all have the experience of making a small change in a PR and waiting for a couple of hours or more for the continuous integration builds to finish. This is because at the moment, all builds (even if it only fixes a typo in a comment) is built from scratch as a clean build. I was wondering if we can do incremental builds instead for changes to PRs. So, a clean build will still happen when a PR is submitted for the first time. But every time a change is made to the PR, we should be able to do an incremental build from the previous build that was done for that PR. This will drastically reduce the waiting time for developers. I have an idea to do this which involves creating a separate directory in jenkins slaves for each PR and doing the build for that PR under its own directory. These directories can be created in EFS and they can be deleted when the PR is closed. I'm wondering if there is a better/easier way to do this. Please let me know if you know of any. Thanks, Indu --94eb2c0d22e6ce564a055b261039--