www-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gavin McDonald <ga...@16degrees.com.au>
Subject [JENKINS] - More build NODES ; Less build LABELS
Date Sat, 12 Nov 2016 00:41:36 GMT
HI All,

As some of you may have noticed, we have been working behind the scenes in Infra making some
improvements 
to the overall stability and health of Jenkins.

New Nodes
=========

Recently, we have added another 9 nodes  H12 - H20 of which H12 to H18 are general purpose
nodes for everyone.

Previously we added jenkins-us1, jenkins-eu2 and jenkins-eu3 again general purpose.
ubuntu-3 (Hemera) has been taken offline.

New Windows Nodes - we have 2 new windows 2012 nodes, which directly replaced windows1 and
windows2. 

Labels Removed
=============

As promised some time ago, quite a few labels that were deemed no longer required, have been
removed.

Labels removed: yahoo-not-h2, docker, HDFS, MapReduce, Pig, Falcon, Tez and ZooKeeper.

The current list of mapped Nodes to Labels can be found on our wiki page here:-

https://cwiki.apache.org/confluence/display/INFRA/Jenkins+node+labels <https://cwiki.apache.org/confluence/display/INFRA/Jenkins+node+labels>


In general, if you are a Hadoop related project, you would use as a priority the ‘Hadoop’
label for  H0-H9 - thats 10 nodes.
If not a Hadoop related project, use the ‘ubuntu’ label  which currently consists of 17
nodes.
You may mix n match - if appropriate use Hadoop||ubuntu for a choice of 27 nodes.

For Windows, please just use the generic ‘Windows’ label - as we add more Windows nodes
they will get this label.

Reserved Nodes
=============

There are specific nodes that have priority for projects - such as the Beam* nodes, the Cassandra*
nodes etc. These are all 
listed in the above wiki page. These are not included in the generic ‘ubuntu’ labels.

In addition, H nodes H19 and H20 are reserved - they are for all projects to use, however
they are restricted to those projects 
that want to use Jenkins + Git + Gitpubsub in order to publish their main www website(s).
I’ll do a new post up specifically 
on this topic soon, but we are looking for one or two projects as testers so please email
if interested in knowing more.

Summary
=======

We have more nodes and less labels. yay!

Even more nodes are coming soon also so do stay tuned.

When I removed labels I also changed job configurations to replace any matching labels with
alternative remaining labels.
Some projects have already reverted to previous configurations and are failing to build as
a result. Please check your 
jobs ASAP and change them in necessary,

Thanks All, any questions or comments, direct to the builds@ list please.

Gav… (ASF Infra.)




Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message