Mailing-List: contact builds-help@apache.org; run by ezmlm
Precedence: bulk
Reply-To: builds@apache.org
MIME-Version: 1.0
In-Reply-To: <9E12602B-B754-4BF3-8F98-69E19C7DDFF4@16degrees.com.au>
References: <903C6B28-01A0-4916-BD86-B92C88AED89E@apache.org>
 <CAD5tkZYyzvZS_FnuXXd-YsprD+00W-82PEH9t6yAuskOjrUb5g@mail.gmail.com>
 <CAE7C0Pf+XkkRw=Xk_Z0RSN-Lriw4FW5R30Le2ohi2OkTpZ+yfQ@mail.gmail.com>
 <C0613EEC-F568-4EE1-9223-AAD200893020@apache.org> <5183D8A1-F498-4C1A-BB7D-D70556DB167C@apache.org>
 <CAFAMeYKGK8RWkqWH58F9n8UhK3gjUTvAjxJrJ_QyJQ12-gx-WA@mail.gmail.com>
 <CA+0K2P_OrMv76HTvH6RhwL=1j39FakGtScgEhuGt5J0PkNw1dg@mail.gmail.com>
 <CAE7C0Pdb61g1M6k3TsReYL_qynYPfVH541yhSjED+uUGuwxxGw@mail.gmail.com>
 <28690B40-FD38-4BF3-8D2D-7CBA03EDDA62@apache.org> <CAH9eYVrd+T+dUZR_tpT7zxBFV0A_JYf5q+PZRqu3qQhfPoSOxg@mail.gmail.com>
 <9E12602B-B754-4BF3-8F98-69E19C7DDFF4@16degrees.com.au>
From: Brian Demers <brian.demers@gmail.com>
Date: Thu, 20 Jul 2017 22:49:04 -0400
Message-ID: <CAH9eYVpk9EYN3n4W__vPq-qwkZthJ4X0GZ7o=tw6p8tNFg9zyQ@mail.gmail.com>
Subject: Re: jenkins emergency restart notice - Tues 00:00 UTC
To: builds@apache.org
Content-Type: multipart/alternative; boundary="f403045dc13691431b0554cae849"
archived-at: Fri, 21 Jul 2017 02:49:14 -0000

--f403045dc13691431b0554cae849
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Ahh, thanks Gavin!

On Thu, Jul 20, 2017 at 7:30 PM, Gavin McDonald <gavin@16degrees.com.au>
wrote:

> Maven type jobs now require JDK 1.8 or above
>
> I changed your build and it now passes.
>
> Let me know if you encounter further problems.
>
> Gav=E2=80=A6
>
> > On 21 Jul 2017, at 2:29 am, Brian Demers <Brian.Demers@gmail.com> wrote=
:
> >
> > Is this failure related to this? or is there a node that is down?
> >
> > https://builds.apache.org/job/Shiro/502/console
> >
> > [EnvInject] - Loading node environment variables.
> > ERROR: SEVERE ERROR occurs
> > org.jenkinsci.lib.envinject.EnvInjectException:
> > hudson.remoting.ChannelClosedException: channel is already closed
> >       at org.jenkinsci.plugins.envinject.service.
> EnvironmentVariablesNodeLoader.gatherEnvVarsForNode(
> EnvironmentVariablesNodeLoader.java:95)
> >       at org.jenkinsci.plugins.envinject.EnvInjectListener.
> loadEnvironmentVariablesNode(EnvInjectListener.java:80)
> >       at org.jenkinsci.plugins.envinject.EnvInjectListener.
> setUpEnvironment(EnvInjectListener.java:43)
> >       at hudson.model.AbstractBuild$AbstractBuildExecution.
> createLauncher(AbstractBuild.java:528)
> >       at hudson.model.AbstractBuild$AbstractBuildExecution.run(
> AbstractBuild.java:448)
> >       at hudson.model.Run.execute(Run.java:1735)
> >       at hudson.maven.MavenModuleSetBuild.run(
> MavenModuleSetBuild.java:542)
> >       at hudson.model.ResourceController.execute(
> ResourceController.java:97)
> >       at hudson.model.Executor.run(Executor.java:405)
> > Caused by: hudson.remoting.ChannelClosedException: channel is already
> closed
> >       at hudson.remoting.Channel.send(Channel.java:605)
> >       at hudson.remoting.Request.call(Request.java:130)
> >       at hudson.remoting.Channel.call(Channel.java:829)
> >       at hudson.FilePath.act(FilePath.java:1081)
> >       at org.jenkinsci.plugins.envinject.service.
> EnvironmentVariablesNodeLoader.gatherEnvVarsForNode(
> EnvironmentVariablesNodeLoader.java:64)
> >       ... 8 more
> > Caused by: java.io.IOException
> >       at hudson.remoting.Channel.close(Channel.java:1292)
> >       at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:180)
> >       at hudson.remoting.PingThread.ping(PingThread.java:130)
> >       at hudson.remoting.PingThread.run(PingThread.java:86)
> > Caused by: java.util.concurrent.TimeoutException: Ping started at
> > 1500559004189 hasn't completed by 1500559244191
> >       ... 2 more
> > [EnvInject] - [ERROR] - SEVERE ERROR occurs: channel is already closed
> >
> >
> > On Wed, Jul 19, 2017 at 11:50 AM, Chris Lambertus <cml@apache.org>
> wrote:
> >
> >> I just commented on that ticket. Looks like this was primarily due to
> the
> >> switch to systemd startup in ubuntu 16.04 and the need to update
> >> DefaultLimitNOFILE in /etc/systemd/system.conf (grr) to affect process=
es
> >> started via systemctl. Thanks Joan Touzet for pointing this out.
> >>
> >> -Chris
> >>
> >>
> >>
> >>> On Jul 19, 2017, at 8:47 AM, Geoff Macartney <
> >> geoff.macartney@cloudsoft.io> wrote:
> >>>
> >>> Apache Brooklyn builds seem to be ok now, thanks.
> >>>
> >>> On Wed, 19 Jul 2017, 16:09 Dominik Psenner, <dpsenner@gmail.com>
> wrote:
> >>>
> >>>> I filed https://issues.apache.org/jira/browse/INFRA-14628 which is
> >>>> probably
> >>>> related to this since the exception message says "Too many open
> files".
> >>>>
> >>>> 2017-07-19 17:01 GMT+02:00 Mike Drob <mdrob@apache.org>:
> >>>>
> >>>>> Have the changes resulted in any noticeable improvements? Is there =
a
> >> JIRA
> >>>>> interested folks can follow along on?
> >>>>>
> >>>>> On Tue, Jul 18, 2017 at 6:40 PM, Chris Lambertus <cml@apache.org>
> >> wrote:
> >>>>>
> >>>>>> We=E2=80=99re trying a suggested downgrade of the credentials bind=
ing plugin
> >>>>> which
> >>>>>> may be related to this. No guarantees, though. I will be restartin=
g
> >>>> again
> >>>>>> tonight at 0100 UTC 19 July.
> >>>>>>
> >>>>>> -Chris
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>> On Jul 18, 2017, at 9:00 AM, Chris Lambertus <cml@apache.org>
> wrote:
> >>>>>>>
> >>>>>>> This appears to be a bug in one of the new versions of either
> jenkins
> >>>>> or
> >>>>>> a plugin. We are still looking into the issue. The limit was raise=
d
> >>>>>> yesterday by a factor of 4.
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>> On Jul 18, 2017, at 4:08 AM, Geoff Macartney <
> >>>>>> geoff.macartney@cloudsoft.io> wrote:
> >>>>>>>>
> >>>>>>>> We're seeing them in Apache Brooklyn builds too, e.g.
> >>>>>>>> https://builds.apache.org/job/brooklyn-server-master/664.
> >>>>>>>>
> >>>>>>>> regards
> >>>>>>>> Geoff
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Tue, 18 Jul 2017 at 12:03 Ismael Juma <ismael@juma.me.uk>
> wrote:
> >>>>>>>>
> >>>>>>>>> Hi,
> >>>>>>>>>
> >>>>>>>>> Thanks for the heads up. Was this done? We are still seeing "to=
o
> >>>> many
> >>>>>> open
> >>>>>>>>> files" issues in Kafka builds. One example of many:
> >>>>>>>>>
> >>>>>>>>> https://builds.apache.org/job/kafka-trunk-jdk7/
> >>>>>> lastCompletedBuild/console
> >>>>>>>>>
> >>>>>>>>> Ismael
> >>>>>>>>>
> >>>>>>>>> On Mon, Jul 17, 2017 at 2:53 PM, Chris Lambertus <cml@apache.or=
g
> >
> >>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Jenkins will be restarted at midnight tonight UTC to address
> >>>>> problems
> >>>>>>>>>> related to =E2=80=98too many open files=E2=80=99 and to attemp=
t to correct a
> >>>> problem
> >>>>>> with
> >>>>>>>>>> some windows agents. I will be stopping new builds so that the
> >>>> queue
> >>>>>> can
> >>>>>>>>>> empty over the next 2 hours.
> >>>>>>>>>>
> >>>>>>>>>> -Chris
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Dominik Psenner
> >>>>
> >>
> >>
>
>

--f403045dc13691431b0554cae849--