Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Subject: Re: ASF OS X Build Infrastructure
MIME-Version: 1.0
From: Chris Nauroth <cnauroth@hortonworks.com>
To: Allen Wittenauer <aw@apache.org>, Hadoop Common
	<common-dev@hadoop.apache.org>
CC: "mapreduce-dev@hadoop.apache.org" <mapreduce-dev@hadoop.apache.org>,
	"hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>,
	"yarn-dev@hadoop.apache.org" <yarn-dev@hadoop.apache.org>
Thread-Topic: ASF OS X Build Infrastructure
Thread-Index: AQHRse1DJ62mE/10k0aKIa/kbw8qVZ/AflgA
Date: Thu, 19 May 2016 17:08:47 +0000
Message-ID: <D3633FEE.43CF7%cnauroth@hortonworks.com>
References: <110D94FC-2E63-4AFF-ACB5-FAC2A0D3C208@apache.org>
In-Reply-To: <110D94FC-2E63-4AFF-ACB5-FAC2A0D3C208@apache.org>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-messagesentrepresentingtype: 1
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [73.254.66.69]
x-source-routing-agent: Processed
Content-Type: text/plain; charset="Windows-1252"
Content-ID: <DD1F5C84717EF94E8B31CFCE1286BAD6@exch080.serverpod.net>
Content-Transfer-Encoding: quoted-printable
archived-at: Thu, 19 May 2016 17:09:31 -0000

Allen, thank you for doing this.

Regarding lack of personal access to anything but Linux, I'll take this as
an opportunity to remind everyone that ASF committers (not just limited to
Hadoop committers) are entitled to a free MSDN license, which can get you
a Windows VM for validating Windows issues and any patches that touch
cross-platform concerns, like the native code.  Contributors who are not
committers still might struggle to get access to Windows, but all of us
reviewing and committing patches do have access.

It has long been on my TODO list to set up similar Jenkins jobs for
Windows, but it keeps slipping.  I'll try once again to bump up priority.

--Chris Nauroth


On 5/19/16, 9:41 AM, "Allen Wittenauer" <aw@apache.org> wrote:

>=09
>=09Some of you may not know that the ASF actually does have an OS X machin=
e
>(a Mac mini, so it=B9s not a speed demon) in the build infrastructure.
>While messing around with getting all? of the trunk jobs reconfigured to
>do Java 8 and separate maven repos, I noticed that this box tends to sit
>idle most of the day. Why take advantage of it?  Therefore, I also setup
>two jobs for us to use to help alleviate the =B3I don=B9t have access to
>anything but Linux=B2 excuse when writing code that may not work in a
>portable manner.
>
>Jobs #1:
>
>=09https://builds.apache.org/view/H-L/view/Hadoop/job/Precommit-HADOOP-OSX
>
>=09This basically runs Apache Yetus precommit with quite a few of the
>unnecessary tests disabled.  For example, there=B9s no point in running
>checkstyle.  Note that this job takes the *full* JIRA issue id as input.
>So =8CHADOOP-9902=B9 not =8C9902=B9.  This allows for one Jenkins job to b=
e used
>for all the Hadoop sub-projects (HADOOP, HDFS, MR, YARN).  =B3But my code
>is on github and I don=B9t want to upload a patch!=B2  I haven=B9t tested =
it,
>but it should also take a URL, so just add a .diff to the end of your
>github compare URL and put that in the issue box.  It hypothetically
>should work.
>
>Job #2:
>
>=09I=B9m still hammering on this one because the email notifications aren=
=B9t
>working to my satisfaction plus we have some extremely Linux-specific
>code in YARN=8A but=20
>
>=09https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-trunk-osx-jav=
a8
>/
>
>=09=8A is a =B3build the world=B2 job similar to what is currently running=
 under
>the individual sub projects.  (This actually makes it one of the few
>=B3build everything=B2 jobs we have running. Most of the other jobs only
>build that particular sub project.).  It does not run the full unit test
>suite and it also does not build all of the native code.  This gives us a
>place to start on our journey of making Hadoop actually, truly run
>everywhere.  (Interesting side note: It=B9s been *extremely* consistent in
>what fails vs. the Linux build hosts.)
>
>=09At some point, likely after YETUS-390 is complete, I=B9ll switch this j=
ob
>over to be run by Apache Yetus in qbt mode so that it=B9s actually easier
>to track failures across all dirs.  A huge advantage over raw maven
>commands.
>
>=09Happy testing everyone.
>
>=09NOTE: if you don=B9t have access to launch jobs on builds.apache.org,
>you=B9ll need to send a request to private@.  The Apache Hadoop PMC has th=
e
>keys to give access to folks.
>
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>


---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org