www-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gavin McDonald <ga...@16degrees.com.au>
Subject Re: Turning Off Bb-fbsd2
Date Fri, 10 Feb 2017 02:29:59 GMT

> On 10 Feb 2017, at 12:38 pm, Allen Wittenauer <aw@effectivemachines.com> wrote:
>> On Feb 9, 2017, at 4:32 PM, Greg Stein <gstein@gmail.com> wrote:
>> I also believe we had to pay for that box, and it wasn't cheap.
> 	I had it in my head that it was from the Apple hardware donation that happened a while
back, but that was a long time ago.  (So long ago that it appears to have been wiped from
the ASF website.)

The last Apple we had was a purchased mac mini for Buildbot and later opened up for Jenkins,
for Jenkins though it was not that reliable and how constant connectivity issues.


> last I checked, there have been no new build machines added to the Hadoop pool.

Not true. More on this below.

>  In fact, we usually run at a deficit because machines are always down. (right now, we're
at something like 60% capacity: H2,H3,H7,H8,H9 are all offline).

Thanks, if not already, I’ll let our host donators of those boxes Yahoo! know about that.
We started sending notifications of disconnected boxes to mailing lists, but got complaints,
so that has stopped.

>  So while the build farm may have increased for the ASF overall, Hadoop is not benefitting
from a hardware increase.

As above, not true, this page explains more:-

https://cwiki.apache.org/confluence/display/INFRA/Jenkins+node+labels <https://cwiki.apache.org/confluence/display/INFRA/Jenkins+node+labels>

I have been very careful with the wording on that page in each labelled section.

tl;dr here are 4 sections on that page:-

1. The Hadoop Nodes H0-H9 - Hadoop and related projects have priority 
2. H* Nodes that are generic and available to all (Not specifically Hadoop and related) 
3. The generic ‘ubuntu’ nodes - everybody is welcome
4. Miscellaneous nodes - Everybody is welcome!

That is a minimum of 27 nodes at your disposal and this number is set to increase even further
H0-H9 are priority for Hadoop and related projects, but it does not mean you can not use other
nodes, you can, 
‘everybody is welcome’ includes Hadoop!

In other words, feel free to change your job labels from ‘Hadoop’ to ‘Hadoop &&
ubuntu’ etc...

>  We've benefitted from fixing our own build jobs and from the infra team's work on Jenkins
>> Today, if a machine goes down,
>> we can spin it back up in an hour or two due to the consistency.
> 	Great, so I should expect for all of our nodes to come back up quickly then, right?

With the exception of the Nodes hosted by Yahoo! and other donators where we don't have console
access, pretty much.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message