infra-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Thistlethwaite (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (INFRA-16380) Nodes Failing With "Backing Channel '<slave_name>' is disconnected.
Date Wed, 30 May 2018 13:37:00 GMT

    [ https://issues.apache.org/jira/browse/INFRA-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16495169#comment-16495169
] 

Chris Thistlethwaite commented on INFRA-16380:
----------------------------------------------

[~swegner] a lot of the features we need from Datadog aren't supported in the puppet module
version we're currently running. In order to get detailed bits like process and memory usage
using DD, we'd need to run the latest DD agent, which requires an updated module, which requires
Puppet 5. We're actively working on updating the entire stack, but I don't have an ETA. 

For now, feel free to ping us about additional metrics.

> Nodes Failing With "Backing Channel '<slave_name>' is disconnected.
> -------------------------------------------------------------------
>
>                 Key: INFRA-16380
>                 URL: https://issues.apache.org/jira/browse/INFRA-16380
>             Project: Infrastructure
>          Issue Type: Bug
>          Components: Jenkins
>            Reporter: Jason Kuster
>            Assignee: Chris Thistlethwaite
>            Priority: Major
>         Attachments: beammemusage.png
>
>
> We've seen a couple of Jenkins builds dying with the cited error. They generally look
like the following:
> https://builds.apache.org/job/beam_PreCommit_Java_GradleBuild/4179/console
> {code}
> FATAL: command execution failed
> java.io.IOException: Backing channel 'beam2' is disconnected.
> 	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:212)
> 	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:281)
> 	at com.sun.proxy.$Proxy131.isAlive(Unknown Source)
> 	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1138)
> 	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1130)
> 	at hudson.Launcher$ProcStarter.join(Launcher.java:465)
> 	at hudson.plugins.gradle.Gradle.performTask(Gradle.java:333)
> 	at hudson.plugins.gradle.Gradle.perform(Gradle.java:225)
> 	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> 	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
> 	at hudson.model.Build$BuildExecution.build(Build.java:206)
> 	at hudson.model.Build$BuildExecution.doRun(Build.java:163)
> 	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
> 	at hudson.model.Run.execute(Run.java:1724)
> 	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> 	at hudson.model.ResourceController.execute(ResourceController.java:97)
> 	at hudson.model.Executor.run(Executor.java:429)
> Caused by: java.io.IOException: Unexpected termination of the channel
> 	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
> Caused by: java.io.EOFException
> 	at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2671)
> 	at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3146)
> 	at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:858)
> 	at java.io.ObjectInputStream.<init>(ObjectInputStream.java:354)
> 	at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
> 	at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
> 	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
> Build step 'Invoke Gradle script' changed build result to FAILURE
> Build step 'Invoke Gradle script' marked build as failure
> ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for beam_PreCommit_Java_GradleBuild
#4179
> ERROR: beam2 is offline; cannot locate JDK 1.8 (latest)
> ERROR: beam2 is offline; cannot locate JDK 1.8 (latest)
> ERROR: beam2 is offline; cannot locate JDK 1.8 (latest)
> ERROR: beam2 is offline; cannot locate JDK 1.8 (latest)
> Setting status of 1073baaaa633dd34ed552812e65108944eb92ac6 to FAILURE with url https://builds.apache.org/job/beam_PreCommit_Java_GradleBuild/4179/
and message: 'FAILURE
>  '
> Using context: Jenkins: ./gradlew :javaPreCommit
> ERROR: beam2 is offline; cannot locate JDK 1.8 (latest)
> Finished: FAILURE
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message