Return-Path: X-Original-To: apmail-builds-archive@minotaur.apache.org Delivered-To: apmail-builds-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7D11317487 for ; Thu, 20 Aug 2015 06:56:08 +0000 (UTC) Received: (qmail 62032 invoked by uid 500); 20 Aug 2015 06:56:08 -0000 Delivered-To: apmail-builds-archive@apache.org Received: (qmail 61970 invoked by uid 500); 20 Aug 2015 06:56:08 -0000 Mailing-List: contact builds-help@apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: builds@apache.org Delivered-To: mailing list builds@apache.org Received: (qmail 61947 invoked by uid 99); 20 Aug 2015 06:56:07 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Aug 2015 06:56:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 5946F182105; Thu, 20 Aug 2015 06:56:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.881 X-Spam-Level: ** X-Spam-Status: No, score=2.881 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id k9nHdy0ch0v6; Thu, 20 Aug 2015 06:56:01 +0000 (UTC) Received: from mail-lb0-f177.google.com (mail-lb0-f177.google.com [209.85.217.177]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id EEA902100B; Thu, 20 Aug 2015 06:56:00 +0000 (UTC) Received: by lbbsx3 with SMTP id sx3so17748066lbb.0; Wed, 19 Aug 2015 23:55:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=Ifj2J23jOsJP3oPYHaUbDiiq6Q7ZeeLnKHPhukXLMEw=; b=hK6DgXPTu2bm0qizULQUeW7752fPR7G4BMJ6Lvai4590kznBE6YA2ekAE9WcYM30yq IdC6dI5H7Q+uRA5EoyRhOQtkj6eF/Fe+X+aP0SlD3QRRGwjxmc5hmdei2EMrvzbUucgE FK4SjZyxC4rIZ3mt3dn7mTelaztCfJq99UQB8YG1w9NFymSC+TyLW3YaScixwGZavVvB zlruf1bMELtjv4XIBZ//KmFllcTt4oPXN5sbCykLHhP31SaJEsNaoX8nyLW6k32oXRi3 EvLo8FUpkAPaox98TP5miQUMdRqy9NCR+YXPHU4bH3SvTLe/PaxTmSWRpIrM7aWFhG18 w8aA== X-Received: by 10.152.25.166 with SMTP id d6mr476954lag.79.1440053759435; Wed, 19 Aug 2015 23:55:59 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.181.101 with HTTP; Wed, 19 Aug 2015 23:55:39 -0700 (PDT) In-Reply-To: References: From: Daan Hoogland Date: Thu, 20 Aug 2015 08:55:39 +0200 Message-ID: Subject: Re: Build slave capacity on builds.apache.org To: builds Cc: andrew bayer Content-Type: multipart/alternative; boundary=089e0160c0dac9e9a6051db8a425 --089e0160c0dac9e9a6051db8a425 Content-Type: text/plain; charset=UTF-8 cloudstack...! we started making more intensive use of pull-builders. the old pull-request build job is replaced by a rat and an analysis job. Maybe others have done so as well but I am sure we (ACS) are a culprit in this. On Thu, Aug 20, 2015 at 4:28 AM, David Nalley wrote: > So, just spot checking some of the dynamic build slaves - historically > those have spun up a few hours at a time, to give us additional > capacity when our queue spiked - but it looks like the slaves are > staying online pretty much all of the time. Right now we are > configured to have 12 slaves. Assuming they are staying online all the > time, that's roughly $2600 per month that we are spending on build > slave capacity - I looked at our last bill ending July 24th, and we > spent about $1200 on build slave capacity - so this is about 2x what > we were spending - I am curious why the sudden uptick in demand - > what's changed? > > --David > > On Wed, Aug 19, 2015 at 9:18 PM, David Nalley wrote: > > Andrew: > > > > I know Jenkins tracks how big the queue is, is that something that we > > can graph over time? It'd be interesting to know how that's changed > > and will change, otherwise we'll constantly be fighting fires here. > > > > I'd like to have the following items graphed: > > > > # of dynamic slaves in operation > > # of executors currently in use > > # of jobs in the queue > > # of jobs in the queue actually waiting on an executor. > > > > It'd be nice to know the average time waiting on an executor as well. > > > > > > I don't suppose Jenkins has any functionality that would allow us to > > run a quota per-project is there? > > > > Since you're one of the resident Jenkins experts how many additional > > build nodes/executors will satiate our current demand for capacity? > > > > > > --David > > > > > > On Tue, Aug 18, 2015 at 11:16 AM, Andrew Bayer > wrote: > >> Hey all - > >> > >> So as you may have noticed, we've seen an increase in build utilization > on > >> builds.a.o in the last few months - which is great! The problem is that > >> we're seeing more demand than we have resources at this point, and > that's > >> only going to increase. We're working on getting more slaves lined up, > but > >> don't yet have a timeframe for that - we'll let you all know when we > have > >> more news. > >> > >> A. > -- Daan --089e0160c0dac9e9a6051db8a425--