From dev-return-4080-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Wed Sep 5 18:58:17 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 5028A180654 for ; Wed, 5 Sep 2018 18:58:16 +0200 (CEST) Received: (qmail 79945 invoked by uid 500); 5 Sep 2018 16:58:15 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Received: (qmail 79927 invoked by uid 99); 5 Sep 2018 16:58:14 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Sep 2018 16:58:14 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 2A2B0CB13B for ; Wed, 5 Sep 2018 16:58:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.889 X-Spam-Level: ** X-Spam-Status: No, score=2.889 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id IsMqNdZRL-VO for ; Wed, 5 Sep 2018 16:58:11 +0000 (UTC) Received: from mail-oi0-f49.google.com (mail-oi0-f49.google.com [209.85.218.49]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 281715F1EA for ; Wed, 5 Sep 2018 16:58:11 +0000 (UTC) Received: by mail-oi0-f49.google.com with SMTP id 13-v6so15043863ois.1 for ; Wed, 05 Sep 2018 09:58:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=UeGJfB3zrpybeZLxcvb+29piDBpydYGeoaTpm75Lb5g=; b=Z0l3A2iMGyc+YfURAHKGXKbpL2RYGvbkn4EoyTnA+2TCLf+SLfddfUzIltRzw/cw5J xCpj+YLGSQOgyYM7ig10wOrBO7+uUAfSbkuZqhqC/DiHUY6VCrjyGP05ydi4ZIsbeWiE mFZa0RpovdMHcKhgTDPmtIhuf+GF1ZnKdz6MxlkwrXCt2Y0e5XdYQskVpYNCZcdreNNr xesLGza7oPuIC5Y6QfB90b5Cl16Lew24q7lAzGfljcMYk1K7W48GnBhMxEykyEWp7zQs lGQKiD+7H/3wETHuqNy68pqQZrwIytNLRzZu6WTtGHn3cBp6aytbnowVj16/sduqDCGo 51Rw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=UeGJfB3zrpybeZLxcvb+29piDBpydYGeoaTpm75Lb5g=; b=Q7gZNaVasYNrc9QVObf1wLWJbtjg2SoaH0f3fGp3nKzxyi9g0IuLP4Pxm/wN0ZrnEL 9nYdLx7o5+x1dgaAkYhpX/4VIj6BRda/5HOp3vMbgL/tuZVrRRneSEo6T3yhDXT+cLkV Iya4p33HGt+H81lyBr8zlZD4gNi4kcxdBt1bSxFE/IkrD5U9hhDYrblQVsQLUdbSHWtb MV/um5spgDxFnZlxFC6/q4Mrb7sa3+xan9OaSivE7WaDEl2gJr5EjRu2DUzBQheNvBZc BZIFPX4yMtULm0taOy813D9OPOtTgc/t2AOb32a4NsARHmuXdMIsvyIRVuZyXA3iFGHv e/Zg== X-Gm-Message-State: APzg51CHKFB0gXEHBnfRGFG3jB/YgfCOjxGZy5tY4OSILvJaGO7PYWth x+UiUWwehrMOmThGdayTaEPsp8+EBUU/yWkSk+MTnA== X-Google-Smtp-Source: ANB0VdaYP/fj0WhsXiASHu8RM1taqGuVX0uJGbBZZMKshtvePhSUAvzQEt2CRILPKHJsngTBFF6qTbqcJZOjsinVOwU= X-Received: by 2002:aca:6a48:: with SMTP id f69-v6mr29853622oic.279.1536166690065; Wed, 05 Sep 2018 09:58:10 -0700 (PDT) MIME-Version: 1.0 References: <5a2fa4b5.e7ae500a.dc8ec.fcb8@mx.google.com> <44E42B54-A6D6-40CE-BDC5-6076B9779A2C@amazon.com> In-Reply-To: From: Lin Yuan Date: Wed, 5 Sep 2018 09:57:58 -0700 Message-ID: Subject: Re: [DISCUSS] Build OSX builds in CI (possibly with TravisCI). To: dev@mxnet.incubator.apache.org Content-Type: multipart/alternative; boundary="000000000000e09290057522add0" --000000000000e09290057522add0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Kellen, I would love to contribute. Please let me know if you have any particular work item that I can help. Best, Lin On Wed, Sep 5, 2018 at 9:51 AM Tianqi Chen wrote= : > is it possible for us to get a MacBook and hook it to the current Jenkins > CI? Travis OSX usually build from scratch and that was pretty slow > > Tianqi > > > On Wed, Sep 5, 2018 at 8:49 AM kellen sunderland < > kellen.sunderland@gmail.com> wrote: > > > Great you feel that way Lin, please feel free to contribute if you have > any > > features you'd like tested. We are using the travis image xcode9.4 whi= ch > > is based on MacOS 10.13. > > > > On Wed, Sep 5, 2018 at 6:40 PM Lin Yuan wrote: > > > > > Hi Kellen, > > > > > > Many thanks for your and Marco's effort! I think this is a very cruci= al > > > piece to improve MXNet stability. > > > > > > To add some data points: > > > 1) Customers using CoreML to MXNet converter were blocked for a while > > > because the converter was broken and no unit test was in place to > detect > > > that. > > > 2) Developers on Mac cannot verify their local commits because some > unit > > > tests on master were broken. This wasted much time and resource on > > jenkins > > > server to detect the failure. > > > 3) Please consider running the CI on Mac OS 10.13 since this is the > > minimum > > > Mac OS version that supports CoreML (to support CoreML to MXNet > > converter) > > > > > > Best Regards, > > > > > > Lin > > > > > > On Wed, Sep 5, 2018, 3:02 AM kellen sunderland < > > > kellen.sunderland@gmail.com> > > > wrote: > > > > > > > I'm bumping this thread as we've recently had our first serious bug > on > > > > MacOS that would have been caught by enabling Travis. > > > > > > > > I'm going to do a little experimental work together with Marco with > the > > > > goal of enabling a minimal Travis build that will run python tests. > So > > > far > > > > I've verified that Travis will in fact find a bug that currently > exists > > > in > > > > master and has been reproduced by MacOS clients. This indicates to > me > > > that > > > > adding Travis will add value to our CI. > > > > > > > > My best guess is that it might take us some iteration before we fin= d > a > > > > scalable way to integrate Travis. Given this we're going to enable > > > Travis > > > > in non-blocking mode (i.e. failures are safe to ignore for the time > > > being). > > > > > > > > To help mitigate the risk of timeouts, and to remove legacy code I'= m > > > going > > > > to re-create the travis.yml file from scratch. I think it'll be mu= ch > > > less > > > > confusing if we only have working code related to Travis in our > > codebase, > > > > so that contributors won't have to experiment to see what is or isn= 't > > > > working. We've got some great, but slightly out-of-date > functionality > > in > > > > the legacy .travis.yml file. I hope we can work together to update > the > > > > legacy features, ensure they work with the current folder structure > and > > > > also make sure the features run within Travis's 45 minute global ti= me > > > > window. > > > > > > > > I'd also like to set expectations that this is strictly a volunteer > > > > effort. I'd welcome help from the community for support and > > maintenance. > > > > The model downloading caching work particularly stands out to me as > > > > something I'd like to re-enable again as soon as possible. > > > > > > > > -Kellen > > > > > > > > On Tue, Jan 9, 2018 at 11:52 AM Marco de Abreu < > > > > marco.g.abreu@googlemail.com> > > > > wrote: > > > > > > > > > Looks good! +1 > > > > > > > > > > On Tue, Jan 9, 2018 at 10:24 AM, kellen sunderland < > > > > > kellen.sunderland@gmail.com> wrote: > > > > > > > > > > > I think most were in favour of at a minimum creating a clang > build > > so > > > > > I've > > > > > > created a PR > > > > > > https://github.com/apache/incubator-mxnet/pull/9330/commits/ > > > > > > 84089ea14123ebe4d66cc92e82a2d529cfbd8b19. > > > > > > My hope is this will catch many of the issues blocking OSX > builds. > > > In > > > > > fact > > > > > > it already caught one issue. If you guys are in favour I can > > remove > > > > the > > > > > > WIP and ask that it be merged. > > > > > > > > > > > > On Thu, Jan 4, 2018 at 6:29 PM, Chris Olivier < > > cjolivier01@gmail.com > > > > > > > > > > wrote: > > > > > > > > > > > > > Nope, I have been on vacation. > > > > > > > > > > > > > > On Thu, Jan 4, 2018 at 9:10 AM, kellen sunderland < > > > > > > > kellen.sunderland@gmail.com> wrote: > > > > > > > > > > > > > > > Hope everyone had a good break. Just wanted to check if > there > > > were > > > > > > > further > > > > > > > > thoughts on OSX builds. Chris, did you have time to look > into > > > > > > > virtualizing > > > > > > > > Mac OS? Would it make sense for us to put something in pla= ce > > in > > > > the > > > > > > > > interim e.g. the clang solution? > > > > > > > > > > > > > > > > On Tue, Dec 12, 2017 at 7:59 PM, de Abreu, Marco < > > > > mabreu@amazon.com> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Thanks for looking into this, Chris! No hurries on that > one, > > > > we=E2=80=99ll > > > > > > look > > > > > > > > > into it next stage when we add new system- and > > > > build-configurations > > > > > > to > > > > > > > > the > > > > > > > > > CI. > > > > > > > > > > > > > > > > > > On 12.12.17, 19:12, "Chris Olivier" > > > > > wrote: > > > > > > > > > > > > > > > > > > I am on vacation starting Thursday. > > > > > > > > > > > > > > > > > > On Tue, Dec 12, 2017 at 9:49 AM kellen sunderland < > > > > > > > > > kellen.sunderland@gmail.com> wrote: > > > > > > > > > > > > > > > > > > > Absolutely, let's do an investigation and see if it= 's > > > > > possible > > > > > > to > > > > > > > > > > virtualize. Would you have time to look into it a > bit > > > > > further? > > > > > > > > > > > > > > > > > > > > On Tue, Dec 12, 2017 at 6:47 PM, Chris Olivier < > > > > > > > > > cjolivier01@gmail.com> > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > Don=E2=80=99t get me wrong, I=E2=80=99m not sayin= g this Mac OS > > Jenkins > > > > > > solution > > > > > > > > is > > > > > > > > > doable > > > > > > > > > > > but I feel like we should investigate because the > > > payoff > > > > > > would > > > > > > > be > > > > > > > > > large. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Dec 12, 2017 at 9:38 AM Chris Olivier < > > > > > > > > > cjolivier01@gmail.com> > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > Apple=E2=80=99s Darwin OS Is recently open-sour= ced. > > > > > > > > > > > > https://github.com/PureDarwin/PureDarwin > > > > > > > > > > > > > > > > > > > > > > > > How to convert this into a non-GUI VM I am not > sure > > > > but I > > > > > > am > > > > > > > > > willing to > > > > > > > > > > > > bet that people have done it already. > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Dec 12, 2017 at 9:16 AM kellen > sunderland < > > > > > > > > > > > > kellen.sunderland@gmail.com> wrote: > > > > > > > > > > > > > > > > > > > > > > > >> It might be technically possible, but I think = it > > > would > > > > > > > violate > > > > > > > > > the > > > > > > > > > > MacOS > > > > > > > > > > > >> license: http://store.apple.com/ > > > > > > > Catalog/US/Images/MacOSX.htm > > > > > > > > > > > >> > > > > > > > > > > > >> "2. Permitted License Uses and Restrictions. > > > > > > > > > > > >> A. This License allows you to install and use > one > > > copy > > > > > of > > > > > > > the > > > > > > > > > Apple > > > > > > > > > > > >> Software on a single Apple-labeled computer at= a > > > time. > > > > > > This > > > > > > > > > License > > > > > > > > > > does > > > > > > > > > > > >> not allow the Apple Software to exist on more > than > > > one > > > > > > > > computer > > > > > > > > > at a > > > > > > > > > > > >> time,and you may not make the Apple Software > > > available > > > > > > over > > > > > > > a > > > > > > > > > network > > > > > > > > > > > >> where > > > > > > > > > > > >> it could be used by multiple computers at the > same > > > > time. > > > > > > You > > > > > > > > > may make > > > > > > > > > > > one > > > > > > > > > > > >> copy of the Apple Software (excluding the Boot > ROM > > > > code) > > > > > > in > > > > > > > > > > > >> machine-readable form for backup purposes only= ; > > > > provided > > > > > > > that > > > > > > > > > the > > > > > > > > > > backup > > > > > > > > > > > >> copy must include all copyright or other > > proprietary > > > > > > notices > > > > > > > > > contained > > > > > > > > > > > on > > > > > > > > > > > >> the original. " > > > > > > > > > > > >> > > > > > > > > > > > >> I could be wrong though, does anyone know the > > > details > > > > of > > > > > > > MacOS > > > > > > > > > > > licensing / > > > > > > > > > > > >> virtualization? > > > > > > > > > > > >> > > > > > > > > > > > >> On Tue, Dec 12, 2017 at 6:10 PM, Chris Olivier= < > > > > > > > > > cjolivier01@gmail.com > > > > > > > > > > > > > > > > > > > > > > >> wrote: > > > > > > > > > > > >> > > > > > > > > > > > >> > googling seems to be full of running OSX (an= d > > even > > > > > > > > > open-sourced > > > > > > > > > > > >> PureDarwin) > > > > > > > > > > > >> > in VMs. One could conceivably run a VM on an > EC2 > > > > > > instance, > > > > > > > > > right? > > > > > > > > > > > >> > > > > > > > > > > > > >> > On Tue, Dec 12, 2017 at 9:01 AM kellen > > sunderland > > > < > > > > > > > > > > > >> > kellen.sunderland@gmail.com> wrote: > > > > > > > > > > > >> > > > > > > > > > > > > >> > > It would be ideal if we could cover OSX in > > > > Jenkins, > > > > > > but > > > > > > > > the > > > > > > > > > only > > > > > > > > > > > >> solution > > > > > > > > > > > >> > > that I'm aware of would require physical > > > machines > > > > to > > > > > > be > > > > > > > > the > > > > > > > > > > workers. > > > > > > > > > > > >> I > > > > > > > > > > > >> > > would be weakly opposed to having physical > > > servers > > > > > > > running > > > > > > > > > on PRs. > > > > > > > > > > > >> The > > > > > > > > > > > >> > > downsides that I see in order of importanc= e: > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > - We can't autoscale physical hardware. > If > > we > > > > > find > > > > > > > that > > > > > > > > > the > > > > > > > > > > load > > > > > > > > > > > is > > > > > > > > > > > >> > too > > > > > > > > > > > >> > > high we have to buy more machines. > > > > > > > > > > > >> > > - Security would be tricky, as they'd hav= e > to > > > be > > > > > > > > connected > > > > > > > > > to the > > > > > > > > > > > >> > internet > > > > > > > > > > > >> > > and then to our Jekins master instance. > > > > Connecting > > > > > > via > > > > > > > a > > > > > > > > > wired > > > > > > > > > > > >> network > > > > > > > > > > > >> > > would probably not be possible on most > > corporate > > > > > > > networks > > > > > > > > > as these > > > > > > > > > > > >> > machines > > > > > > > > > > > >> > > are by definition running arbitrary code > from > > > the > > > > > > > > > internet. Many > > > > > > > > > > > >> > corporate > > > > > > > > > > > >> > > sites have public wifi that this machine > could > > > > > > > potentially > > > > > > > > > connect > > > > > > > > > > > to, > > > > > > > > > > > >> > but > > > > > > > > > > > >> > > then our PRs start failing if the wifi > > > disconnects > > > > > > > > > temporarily. > > > > > > > > > > To > > > > > > > > > > > >> > connect > > > > > > > > > > > >> > > to the master we would need to setup a vpn > > > > solution > > > > > > with > > > > > > > > > endpoints > > > > > > > > > > > in > > > > > > > > > > > >> our > > > > > > > > > > > >> > > vpc on AWS. This is possible but would > > probably > > > > > > > require a > > > > > > > > > lot of > > > > > > > > > > > >> > security > > > > > > > > > > > >> > > work. > > > > > > > > > > > >> > > - We can't just create a simple startup > > script > > > or > > > > > > yaml > > > > > > > > > file that > > > > > > > > > > is > > > > > > > > > > > >> > > checked into GitHub to manage the machine. > > > > Someone > > > > > > will > > > > > > > > > actually > > > > > > > > > > > >> have to > > > > > > > > > > > >> > > physically administer the machine, apply > > > updates, > > > > > etc. > > > > > > > > > which will > > > > > > > > > > > make > > > > > > > > > > > >> > > community ownership difficult. > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > Specific to an OSX build: > > > > > > > > > > > >> > > - We can't virtualize OSX which means we'= d > > only > > > > be > > > > > > able > > > > > > > > to > > > > > > > > > cover > > > > > > > > > > > one > > > > > > > > > > > >> OSX > > > > > > > > > > > >> > > build environment per physical device. We > > > > couldn't > > > > > > > > target a > > > > > > > > > > matrix > > > > > > > > > > > of > > > > > > > > > > > >> > OSX > > > > > > > > > > > >> > > and Xcode versions as in Travis. > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > -Kellen > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > On Tue, Dec 12, 2017 at 5:46 PM, Chris > > Olivier < > > > > > > > > > > > cjolivier01@gmail.com > > > > > > > > > > > >> > > > > > > > > > > > > >> > > wrote: > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > So why Travis when we could possibly use > > > > Jenkins? > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > On Tue, Dec 12, 2017 at 7:59 AM Marco de > > > Abreu < > > > > > > > > > > > >> > > > marco.g.abreu@googlemail.com> > > > > > > > > > > > >> > > > wrote: > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > Yes that's correct, Chris. > > > > > > > > > > > >> > > > > > > > > > > > > > > > >> > > > > Am 12.12.2017 4:46 nachm. schrieb "Chr= is > > > > > Olivier" > > > > > > < > > > > > > > > > > > >> > > cjolivier01@gmail.com > > > > > > > > > > > >> > > > >: > > > > > > > > > > > >> > > > > > > > > > > > > > > > >> > > > > > A quick google search seems to > indicate > > > that > > > > > Mac > > > > > > > can > > > > > > > > > be used > > > > > > > > > > > as > > > > > > > > > > > >> a > > > > > > > > > > > >> > > > Jenkins > > > > > > > > > > > >> > > > > > slave. Is this correct? > > > > > > > > > > > >> > > > > > > > > > > > > > > > > >> > > > > > On Tue, Dec 12, 2017 at 7:42 AM > Steffen > > > > > Rochel < > > > > > > > > > > > >> > > > steffenrochel@gmail.com> > > > > > > > > > > > >> > > > > > wrote: > > > > > > > > > > > >> > > > > > > > > > > > > > > > > >> > > > > > > +1 for #1 and #2 > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > >> > > > > > > I=E2=80=99m working on getting a M= acPro to > add > > > to > > > > CI > > > > > > > > system. > > > > > > > > > > > >> > > > > > > On Tue, Dec 12, 2017 at 1:43 AM > kellen > > > > > > > sunderland > > > > > > > > < > > > > > > > > > > > >> > > > > > > kellen.sunderland@gmail.com> wrote= : > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > >> > > > > > > > Background: TravisCI is a start= up > > > > > providing > > > > > > > > > managed > > > > > > > > > > > >> continuous > > > > > > > > > > > >> > > > > > > > integration services with GitHub > > > > > integration > > > > > > > and > > > > > > > > > YAML > > > > > > > > > > > based > > > > > > > > > > > >> > > > > > > configuration. > > > > > > > > > > > >> > > > > > > > TravisCI is one of the few CI > > > providers > > > > > that > > > > > > > > will > > > > > > > > > build > > > > > > > > > > a > > > > > > > > > > > >> > variety > > > > > > > > > > > >> > > > of > > > > > > > > > > > >> > > > > > > > OSX/MacOS builds for software > > > projects. > > > > > > Their > > > > > > > > > pricing > > > > > > > > > > > >> ranges > > > > > > > > > > > >> > > from > > > > > > > > > > > >> > > > > Free > > > > > > > > > > > >> > > > > > > > (for open source, 1 concurrent > job, > > to > > > > > $489 > > > > > > > > > monthly for > > > > > > > > > > 10 > > > > > > > > > > > >> > > > concurrent > > > > > > > > > > > >> > > > > > > jobs). > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > >> > > > > > > > Problem: We=E2=80=99ve had a few= OSX build > > > > issues > > > > > > slip > > > > > > > > > into > > > > > > > > > > MXNet > > > > > > > > > > > >> > master > > > > > > > > > > > >> > > in > > > > > > > > > > > >> > > > > the > > > > > > > > > > > >> > > > > > > > past few weeks. We=E2=80=99ve p= reviously > > had > > > a > > > > > > Travis > > > > > > > > CI > > > > > > > > > based > > > > > > > > > > > >> testing > > > > > > > > > > > >> > > > > system > > > > > > > > > > > >> > > > > > > that > > > > > > > > > > > >> > > > > > > > would have caught these issues. > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > >> > > > > > > > Proposals so far: > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > >> > > > > > > > 1) Use TravisCI in it=E2=80=99s = free mode > > for > > > a > > > > > very > > > > > > > > > minimal > > > > > > > > > > > sanity > > > > > > > > > > > >> > check > > > > > > > > > > > >> > > > on > > > > > > > > > > > >> > > > > > OSX. > > > > > > > > > > > >> > > > > > > > If we compile the program, and f= or > > > > example > > > > > > run > > > > > > > > > C++ unit > > > > > > > > > > > >> tests > > > > > > > > > > > >> > > we=E2=80=99re > > > > > > > > > > > >> > > > > > > > unlikely to run into problems wi= th > > > > queued > > > > > > > > > builds. The > > > > > > > > > > > total > > > > > > > > > > > >> > > build > > > > > > > > > > > >> > > > > time > > > > > > > > > > > >> > > > > > > > here should be less than 15 > minutes. > > > > > > > > > Configuration > > > > > > > > > > should > > > > > > > > > > > >> be > > > > > > > > > > > >> > > quite > > > > > > > > > > > >> > > > > > > simple > > > > > > > > > > > >> > > > > > > > and easy to maintain. Error > > messages > > > > > should > > > > > > > > also > > > > > > > > > be > > > > > > > > > > > >> obvious to > > > > > > > > > > > >> > > > > > > > contributors. > > > > > > > > > > > >> > > > > > > > 2) Run clang in Linux with our > > current > > > > CI. > > > > > > > > > Building > > > > > > > > > > with > > > > > > > > > > > >> clang > > > > > > > > > > > >> > > > > should > > > > > > > > > > > >> > > > > > > > take less than 10 minutes, shoul= d > > > flush > > > > > out > > > > > > a > > > > > > > > > large > > > > > > > > > > subset > > > > > > > > > > > >> of > > > > > > > > > > > >> > the > > > > > > > > > > > >> > > > > > issues > > > > > > > > > > > >> > > > > > > > we=E2=80=99ve seen with OSX, and= be quite > > easy > > > > to > > > > > > > > > maintain. > > > > > > > > > > > >> > > > > > > > 3) Run full test-suites in > TravisCI, > > > > > > equaling > > > > > > > > the > > > > > > > > > level > > > > > > > > > > of > > > > > > > > > > > >> > > coverage > > > > > > > > > > > >> > > > > we > > > > > > > > > > > >> > > > > > > > provide to Linux in Jenkins. Th= is > > > could > > > > > > > require > > > > > > > > > us to > > > > > > > > > > > >> > subscribe > > > > > > > > > > > >> > > > to a > > > > > > > > > > > >> > > > > > > > monthly package with Travis to > > ensure > > > > our > > > > > > > build > > > > > > > > > queue > > > > > > > > > > > >> doesn=E2=80=99t > > > > > > > > > > > >> > > grow > > > > > > > > > > > >> > > > to > > > > > > > > > > > >> > > > > > an > > > > > > > > > > > >> > > > > > > > unacceptable length. It may als= o > > > > require > > > > > a > > > > > > > > > volunteer to > > > > > > > > > > > >> setup > > > > > > > > > > > >> > > and > > > > > > > > > > > >> > > > > > > maintain > > > > > > > > > > > >> > > > > > > > long-term. > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > >> > > > > > > > I=E2=80=99d +1 #1 and #2 as I th= ink those > > > should > > > > > be > > > > > > > > > low-cost, > > > > > > > > > > > >> > > low-maintence > > > > > > > > > > > >> > > > > > > > solutions that should catch the > > > majority > > > > > of > > > > > > > the > > > > > > > > > problems > > > > > > > > > > > >> we=E2=80=99ve > > > > > > > > > > > >> > > seen > > > > > > > > > > > >> > > > > > thus > > > > > > > > > > > >> > > > > > > > far. > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > >> > > > > > > > -Kellen > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --000000000000e09290057522add0--