Mailing-List: contact dev-help@spark.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CACdU-dRdZsUZ1iKp7P-aeDf-mA=WaW_hvxoPqSJnwhjXn22SLQ@mail.gmail.com>
References: 
 <CACdU-dQbjqtOsvR4cji1M_-ygyWPWjaTeQ9=q7U2aZCQ3t1c6A@mail.gmail.com>
 <CACdU-dSx5WbvzyLLKL+y21fg5n4bkV4ZLsXfju_3x0UNAEqyeg@mail.gmail.com>
 <CACdU-dR9T6McRzEKnWTud06v_oXpHAmTbY38UvtDUs57P8_psA@mail.gmail.com>
 <CACdU-dTcyX4nMn0G-YKANmagzDzfeiOG6pQ=ONvWf7KRCdnmEw@mail.gmail.com>
 <CAAswR-7YYHuq8ghAkccb=n2yzqx-fBVWnn8Ndcjq1XGU_P8e6Q@mail.gmail.com>
 <CACdU-dTbzHA4PLRZ8Wn4pispXtxVK4CjAT=DtFN+x4nLP2HyjA@mail.gmail.com>
 <CACdU-dR+cpdKrMQ430ZqmHvV1azTK--pPdWp=nLzPrZ2sD6wTQ@mail.gmail.com>
 <CACdU-dSd_EioJLhVCxF+9oYcYA6iANprPk5s2euYW=D5nA9jCQ@mail.gmail.com>
 <CAFzSYuxYLE+g8NCf+eK9dLd-Sw4dB0g2Ac9BKjujVXBJGuN6Gg@mail.gmail.com>
 <CACdU-dTrKw99iJ_4Evvorn8JnapGfJpEYHV=qwGuS-qJMRhTRQ@mail.gmail.com>
 <CACdU-dRdZsUZ1iKp7P-aeDf-mA=WaW_hvxoPqSJnwhjXn22SLQ@mail.gmail.com>
From: shane knapp <sknapp@berkeley.edu>
Date: Fri, 6 Nov 2015 13:30:57 -0800
Message-ID: 
 <CACdU-dTJpDab40RjzzCQXeRZ4d6wT+1a2WuwcpU+gmyKjFT83g@mail.gmail.com>
Subject: Re: [BUILD SYSTEM] quick jenkins downtime, november 5th 7am
To: Josh Rosen <joshrosen@databricks.com>
Cc: Michael Armbrust <michael@databricks.com>,
 amp-infra <amp-infra@googlegroups.com>,
	dev <dev@spark.apache.org>
Content-Type: text/plain; charset=UTF-8

ok, i think i've kicked jenkins enough that it's now working again w/o
spamming tracebacks.

sorry for the interruption...  i should have realized that touching
the house of cards (aka ghprb plugin) would cause it to fall down no
matter what i did.  :)

shane

ps - did i mention the hardware for our staging instance just showed up?  :)

On Fri, Nov 6, 2015 at 1:13 PM, shane knapp <sknapp@berkeley.edu> wrote:
> gonna have to kick jenkins again, folks.  sorry!
>
> On Fri, Nov 6, 2015 at 1:11 PM, shane knapp <sknapp@berkeley.edu> wrote:
>> i (stupidly) updated the ghprb plugin as the version we're using is
>> really, really old.  this re-wrote the config and broke stuff.
>>
>> so, i just downgraded the plugin back to the last known working
>> version, and noticed that some of the fields in the xml are missing.
>>
>> thankfully i have a backup config from ~5 days ago....  i'm working on
>> munging them together right now.
>>
>> and thankfully our new hardware has just showed up so i'll have a
>> jenkins staging instance up really, really soon and be able to test
>> stuff like this in the future.
>>
>> shane
>>
>> On Fri, Nov 6, 2015 at 1:04 PM, Josh Rosen <joshrosen@databricks.com> wrote:
>>> Are you sure that the credentials are missing? Also: did you enable GitHub
>>> commit status updating by accident / configuration loss? That might explain
>>> the errors here, since our keys don't have permissions to use that API.
>>>
>>> On Fri, Nov 6, 2015 at 12:54 PM, shane knapp <sknapp@berkeley.edu> wrote:
>>>>
>>>> alright, i'm downgrading our ghprb plugin back to the last known
>>>> working version.  this will require a jenkins restart, which i will do
>>>> immediately.
>>>>
>>>> sorry about this!  :(
>>>>
>>>> On Fri, Nov 6, 2015 at 12:35 PM, shane knapp <sknapp@berkeley.edu> wrote:
>>>> > a pox on the github pull request builder...  the update wiped out the
>>>> > github auth creds.  :\
>>>> >
>>>> > On Fri, Nov 6, 2015 at 12:30 PM, shane knapp <sknapp@berkeley.edu>
>>>> > wrote:
>>>> >> looking in to this now.
>>>> >>
>>>> >> On Fri, Nov 6, 2015 at 12:28 PM, Michael Armbrust
>>>> >> <michael@databricks.com> wrote:
>>>> >>> I'm noticing several problems with Jenkins since the upgrade.
>>>> >>>
>>>> >>> PR comments say: "Build started sha1 is merged." instead of actually
>>>> >>> printing the hash
>>>> >>>
>>>> >>> Also:
>>>> >>>
>>>> >>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45246/console
>>>> >>>
>>>> >>> GitHub pull request #9527 of commit
>>>> >>> 0e0959efada849a56430d30305eb4e9a88ecafad, no merge conflicts.
>>>> >>> Setting status of 0e0959efada849a56430d30305eb4e9a88ecafad to PENDING
>>>> >>> with
>>>> >>> url  and message: 'Build started sha1 is merged.'
>>>> >>> FileNotFoundException means that the credentials Jenkins is using is
>>>> >>> probably wrong. Or the user account does not have write access to the
>>>> >>> repo.
>>>> >>> java.io.FileNotFoundException: {"message":"Not
>>>> >>> Found","documentation_url":"https://developer.github.com/v3"}
>>>> >>>       at
>>>> >>> org.kohsuke.github.Requester.handleApiError(Requester.java:501)
>>>> >>>       at org.kohsuke.github.Requester._to(Requester.java:248)
>>>> >>>       at org.kohsuke.github.Requester.to(Requester.java:194)
>>>> >>>       at
>>>> >>>
>>>> >>> org.kohsuke.github.GHRepository.createCommitStatus(GHRepository.java:829)
>>>> >>>       at
>>>> >>>
>>>> >>> org.jenkinsci.plugins.ghprb.extensions.status.GhprbSimpleStatus.createCommitStatus(GhprbSimpleStatus.java:208)
>>>> >>>       at
>>>> >>>
>>>> >>> org.jenkinsci.plugins.ghprb.extensions.status.GhprbSimpleStatus.onBuildStart(GhprbSimpleStatus.java:147)
>>>> >>>       at
>>>> >>> org.jenkinsci.plugins.ghprb.GhprbBuilds.onStarted(GhprbBuilds.java:122)
>>>> >>>       at
>>>> >>>
>>>> >>> org.jenkinsci.plugins.ghprb.GhprbBuildListener.onStarted(GhprbBuildListener.java:24)
>>>> >>>       at
>>>> >>>
>>>> >>> org.jenkinsci.plugins.ghprb.GhprbBuildListener.onStarted(GhprbBuildListener.java:17)
>>>> >>>       at
>>>> >>> hudson.model.listeners.RunListener.fireStarted(RunListener.java:215)
>>>> >>>       at hudson.model.Run.execute(Run.java:1737)
>>>> >>>       at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
>>>> >>>       at
>>>> >>> hudson.model.ResourceController.execute(ResourceController.java:98)
>>>> >>>       at hudson.model.Executor.run(Executor.java:410)
>>>> >>> Caused by: java.io.FileNotFoundException:
>>>> >>>
>>>> >>> https://api.github.com/repos/apache/spark/statuses/0e0959efada849a56430d30305eb4e9a88ecafad
>>>> >>>       at
>>>> >>> sun.reflect.GeneratedConstructorAccessor174.newInstance(Unknown Source)
>>>> >>>       at
>>>> >>>
>>>> >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>>> >>>       at
>>>> >>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>>> >>>       at
>>>> >>>
>>>> >>> sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1675)
>>>> >>>       at
>>>> >>>
>>>> >>> sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1673)
>>>> >>>       at java.security.AccessController.doPrivileged(Native Method)
>>>> >>>       at
>>>> >>>
>>>> >>> sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1671)
>>>> >>>       at
>>>> >>>
>>>> >>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1244)
>>>> >>>       at
>>>> >>>
>>>> >>> sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)
>>>> >>>       at org.kohsuke.github.Requester.parse(Requester.java:458)
>>>> >>>       at org.kohsuke.github.Requester._to(Requester.java:227)
>>>> >>>       ... 12 more
>>>> >>> Caused by: java.io.FileNotFoundException:
>>>> >>>
>>>> >>> https://api.github.com/repos/apache/spark/statuses/0e0959efada849a56430d30305eb4e9a88ecafad
>>>> >>>       at
>>>> >>>
>>>> >>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1624)
>>>> >>>       at
>>>> >>> java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
>>>> >>>       at
>>>> >>>
>>>> >>> sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>>>> >>>       at org.kohsuke.github.Requester.parse(Requester.java:454)
>>>> >>>       ... 13 more
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> On Fri, Nov 6, 2015 at 8:04 AM, shane knapp <sknapp@berkeley.edu>
>>>> >>> wrote:
>>>> >>>>
>>>> >>>> and we're back!
>>>> >>>>
>>>> >>>> On Fri, Nov 6, 2015 at 7:39 AM, shane knapp <sknapp@berkeley.edu>
>>>> >>>> wrote:
>>>> >>>> > this is happening now.
>>>> >>>> >
>>>> >>>> > On Thu, Nov 5, 2015 at 11:08 AM, shane knapp <sknapp@berkeley.edu>
>>>> >>>> > wrote:
>>>> >>>> >> well, i forgot to put this on my calendar and didn't get around to
>>>> >>>> >> getting it done this morning.  :)
>>>> >>>> >>
>>>> >>>> >> anyways, i'll be shooting for tomorrow (friday) morning instead.
>>>> >>>> >>
>>>> >>>> >> shane
>>>> >>>> >>
>>>> >>>> >> On Mon, Nov 2, 2015 at 9:55 AM, shane knapp <sknapp@berkeley.edu>
>>>> >>>> >> wrote:
>>>> >>>> >>> i'd like to take jenkins down briefly thursday morning to install
>>>> >>>> >>> some
>>>> >>>> >>> plugin updates.
>>>> >>>> >>>
>>>> >>>> >>> this will hopefully be short (~1hr), but could easily become
>>>> >>>> >>> longer as
>>>> >>>> >>> the jenkins plugin ecosystem is fragile and updates like this are
>>>> >>>> >>> known to cause things to explode.  the only reason why i'm
>>>> >>>> >>> contemplating this, is i'm having some issues with the git plugin
>>>> >>>> >>> on
>>>> >>>> >>> new github pull request builder builds.
>>>> >>>> >>>
>>>> >>>> >>> i'll send updates as things progress.
>>>> >>>> >>>
>>>> >>>> >>> thanks,
>>>> >>>> >>>
>>>> >>>> >>> shane
>>>> >>>>
>>>> >>>> ---------------------------------------------------------------------
>>>> >>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>>> >>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>> >>>>
>>>> >>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>>
>>>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org