Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: <CADcMMgH01m_4_BeD9Aw+aTxrAt+0CpGxnvnRvC8Kxjqk65pE0Q@mail.gmail.com>
References: <CADcMMgHnKcUi-aRoS9WgpKBpgN3YRRXsGoJPF5Ci29i3fWnrHA@mail.gmail.com>
 <CAAjhxroDdAxGaxrccy0b6gWoax2MaKGt-nvOVjZ+FuVhCTX8Mw@mail.gmail.com>
 <CAGHyZ6+CJ3S_g=uTyyM2wC11tO8Gx-=oCATnaK=ChhN1d11gKg@mail.gmail.com>
 <CA+RK=_ByEeEAmh0TNTmVNYdPJjm_Z4Vz8hc5G9XXS_h7Hn31=w@mail.gmail.com>
 <FFD67AEC-A0FA-4D8F-B38B-133C37F77263@gmail.com> <CAAjhxrqOE_iWaU_tWy9Mnbm3tp1_97msECU9PSGuWAeOyGPj1g@mail.gmail.com>
 <CA+RK=_AfmUFe05tLwNjZDkYNQ=pa9uV_07wOyU4=CTyafmjkbg@mail.gmail.com>
 <CAN5cbe5NuF3FnRf3=KwxYopu=mgu6D=N3Q26AO=q5HeLPW8WzA@mail.gmail.com>
 <CAN5cbe6R7y517uBs=2fzBrQVb3++Ff-ciaUkiDJHqJL0z_69Gg@mail.gmail.com>
 <CAHxLZBVK1qGv7+rZpHOrdEc==_7-_kdyd_G0hETfjTGKshg2dw@mail.gmail.com>
 <CAN5cbe6wVUzBc0yDD7sNQj_1s6Q21mrzO9qyPunPukJqHUOswg@mail.gmail.com>
 <CADcMMgFAVP73+6tyZ5k_tYhBEJ2J5jHujB6p-Y0v=S_GBnrYcg@mail.gmail.com>
 <CAN5cbe72oEeXA3t-g2vwOurVt9of22jQSo6RCf1PGTndUt5GaQ@mail.gmail.com>
 <CADcMMgHShQane4Fmt_G0CXy-aMF5A6q28Hbn+tHmRzws+ST4YQ@mail.gmail.com>
 <601b6ea1-8987-ee7c-891c-fd1a6643f40a@apache.org> <CADcMMgHnAUmtOVgYb66SE31PLYC+-eZrPSBN6MV2KysqAknLfw@mail.gmail.com>
 <CAN5cbe64OYWtv1zGWQ4Lv719XsZwHgjfT=gJ2hGbfHhGu5VfYw@mail.gmail.com>
 <CADcMMgFJzgoN6oLQQN06e4XcXnGGS4Sgv2uz233-tMqiBZUkKg@mail.gmail.com>
 <CADcMMgGTZgDYCPCNQ4Na9Orqg+LH_FNQc7+0XRfD7=sAC95SHg@mail.gmail.com>
 <CADcMMgHSYd0Lvy6Ugg8d+jHrkKdvYJUzDVrLwbnq0Lc9hJVNTg@mail.gmail.com>
 <CADcMMgHsvM32Hop-DGbLFTJNqpp-KuS6z_9sSSQbgn=YDkEa1w@mail.gmail.com>
 <CAN5cbe4Sz=NfaLdwcmzKKLeWEO63AbYg1Rpe3xVgWyGjGQTk0w@mail.gmail.com>
 <CADcMMgH_QpH21qhnAU3WHE10-YWMUv9SSXn5fH0WcwzmiSoJ4A@mail.gmail.com>
 <CAAjhxrpa36gBZbTYkRGZ-74x0U5w3DLWk+LPusgcOjWXy8_X+w@mail.gmail.com>
 <CAAjhxrpvjaimD1+UFMYQzDUaxgZYn2doYR9_g2yJGwG_GL01FQ@mail.gmail.com> <CADcMMgH01m_4_BeD9Aw+aTxrAt+0CpGxnvnRvC8Kxjqk65pE0Q@mail.gmail.com>
From: Stack <stack@duboce.net>
Date: Mon, 21 Aug 2017 13:54:50 -0700
Message-ID: <CADcMMgF1=qrSwzCp=bjSBJ16b7c1_2DmDSPUOj_XMFsCD5gnOA@mail.gmail.com>
Subject: Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)
To: HBase Dev List <dev@hbase.apache.org>
Content-Type: multipart/alternative; boundary="001a114c0d62a29d5b055749b0cd"
archived-at: Mon, 21 Aug 2017 20:55:04 -0000

--001a114c0d62a29d5b055749b0cd
Content-Type: text/plain; charset="UTF-8"

Loads of tests timing out in test runs -- then they all pass. Anyone have
an input? I'm trying to take a look as background task...

S

On Tue, Jul 11, 2017 at 7:05 PM, Stack <stack@duboce.net> wrote:

> Thanks Appy.
>
> Any one looking at the 'ERROR ExecutionException Java heap space...'
> errors on patch builds or failed forking? Seems common enough. Here are
> complaints that remote JVM went away:
>
> https://builds.apache.org/view/H-L/view/HBase/job/
> PreCommit-HBASE-Build/7617/artifact/patchprocess/patch-
> unit-hbase-server.txt
> https://builds.apache.org/view/H-L/view/HBase/job/
> PreCommit-HBASE-Build/7616/artifact/patchprocess/patch-
> unit-hbase-server.txt
>
> Then this succeeds....
>
> https://builds.apache.org/view/H-L/view/HBase/job/
> PreCommit-HBASE-Build/7614/artifact/patchprocess/patch-
> unit-hbase-server.txt
>
> And we are good for a while.
>
> Then heap issues:
>
> https://builds.apache.org/view/H-L/view/HBase/job/
> PreCommit-HBASE-Build/7607/artifact/patchprocess/patch-
> unit-hbase-server.txt
>
> Are the zombies back?
>
> St.Ack
>
> On Tue, Jul 11, 2017 at 12:33 AM, Apekshit Sharma <appy@cloudera.com>
> wrote:
>
>> Fixed 'trends' in flaky dashboard. Since i changed the test names in last
>> fix, the dots in the name were messing up with CSS selectors. :)
>>
>>
>> On Mon, Jul 10, 2017 at 11:34 AM, Apekshit Sharma <appy@cloudera.com>
>> wrote:
>>
>> > Quick update on flaky dashboard:
>> > Flaky dashboard wasn't working earlier because our trunk build was
>> broken.
>> > After trunk was fixed, the format of log lines in consoleText was not
>> the
>> > same, so findHangingTests.py was not able to parse it correctly for
>> > broken/hanging/timeout tests. That's been fixed now HBASE-18341
>> > <https://issues.apache.org/jira/browse/HBASE-18341>.
>> > Drob brought up in other thread that 'treads' isn't working. It's
>> probably
>> > because i changed tests names (which are used as keys in python dicts)
>> from
>> > just class name to package name+classname (without common
>> > org.apache.hadoop.hbase prefix). I had to do it because we have some
>> tests
>> > with same class name but in different packages.
>> >
>> > I'll take a look at it sometime this week (unless someone wants to take
>> it
>> > up and work on this beautiful piece of infra ;) )
>> >
>> >
>> > On Thu, Jul 6, 2017 at 11:25 PM, Stack <stack@duboce.net> wrote:
>> >
>> >> On Thu, Jul 6, 2017 at 3:45 PM, Sean Busbey <busbey@apache.org> wrote:
>> >>
>> >> > that sounds like our project structure is broken. Please make sure
>> >> there's
>> >> > a jira that tracks it and I'll take a look later.
>> >> >
>> >> >
>> >>
>> >> Filed HBASE-18331 for now.
>> >>
>> >> I can take a look too later.
>> >>
>> >> St.Ack
>> >>
>> >>
>> >>
>> >> > On Thu, Jul 6, 2017 at 6:15 PM, Stack <stack@duboce.net> wrote:
>> >> >
>> >> > > I tried publishing hbase-3.0.0-SNAPSHOT... so hbase-checkstyle was
>> up
>> >> in
>> >> > > repo (presuming it relied on an aged-out snapshot). Seems to have
>> >> 'fixed'
>> >> > > it for now....
>> >> > >
>> >> > > St.Ack
>> >> > >
>> >> > > On Thu, Jul 6, 2017 at 12:50 PM, Stack <stack@duboce.net> wrote:
>> >> > >
>> >> > > > The 3.0.0-SNAPSHOT looks suspicious ... the hbase version....
>> >> > > > St.Ack
>> >> > > >
>> >> > > > On Thu, Jul 6, 2017 at 12:49 PM, Stack <stack@duboce.net> wrote:
>> >> > > >
>> >> > > >> On Thu, Jul 6, 2017 at 12:48 PM, Stack <stack@duboce.net>
>> wrote:
>> >> > > >>
>> >> > > >>> Checkstyle is currently broke on our builds... looking.
>> >> > > >>> St.Ack
>> >> > > >>>
>> >> > > >>>
>> >> > > >> Works if I run it locally (of course)
>> >> > > >> St.Ack
>> >> > > >>
>> >> > > >>
>> >> > > >>
>> >> > > >>
>> >> > > >>>
>> >> > > >>>
>> >> > > >>> [ERROR] Failed to execute goal org.apache.maven.plugins:
>> >> > > maven-checkstyle-plugin:2.17:checkstyle (default-cli) on project
>> >> hbase:
>> >> > > Execution default-cli of goal org.apache.maven.plugins:
>> >> > > maven-checkstyle-plugin:2.17:checkstyle failed: Plugin
>> >> > > org.apache.maven.plugins:maven-checkstyle-plugin:2.17 or one of
>> its
>> >> > > dependencies could not be resolved: Could not find artifact
>> >> > > org.apache.hbase:hbase-checkstyle:jar:3.0.0-SNAPSHOT in Nexus (
>> >> > > http://repository.apache.org/snapshots) -> [Help 1][ERROR]
>> [ERROR] To
>> >> > see
>> >> > > the full stack trace of the errors, re-run Maven with the -e
>> >> > switch.[ERROR]
>> >> > > Re-run Maven using the -X switch to enable full debug
>> logging.[ERROR]
>> >> > > [ERROR] For more information about the errors and possible
>> solutions,
>> >> > > please read the following articles:[ERROR] [Help 1]
>> >> > > http://cwiki.apache.org/confluence/display/MAVEN/
>> >> > > PluginResolutionExceptionBuild step 'Invoke top-level Maven
>> targets'
>> >> > > marked build as failure
>> >> > > >>> Performing Post build task...
>> >> > > >>> Match found for :.* : True
>> >> > > >>> Logical operation result is TRUE
>> >> > > >>> Running script  : # Run zombie detector script
>> >> > > >>> ./dev-support/zombie-detector.sh --jenkins ${BUILD_ID}
>> >> > > >>> [a3159d73] $ /bin/bash -xe /tmp/hudson1697041977582083402.sh
>> >> > > >>> + ./dev-support/zombie-detector.sh --jenkins 3320
>> >> > > >>> Thu Jul  6 01:37:09 UTC 2017 We're ok: there is no zombie test
>> >> > > >>>
>> >> > > >>>
>> >> > > >>>
>> >> > > >>>
>> >> > > >>> On Fri, Jun 30, 2017 at 2:43 PM, Sean Busbey <
>> busbey@apache.org>
>> >> > > wrote:
>> >> > > >>>
>> >> > > >>>> jacoco was added ages ago. I'd guess that something changed on
>> >> the
>> >> > > >>>> machines
>> >> > > >>>> we use to cause it to stop working.
>> >> > > >>>>
>> >> > > >>>> On Thu, Jun 29, 2017 at 12:02 PM, Stack <stack@duboce.net>
>> >> wrote:
>> >> > > >>>>
>> >> > > >>>> > On Wed, Jun 28, 2017 at 8:43 AM, Josh Elser <
>> elserj@apache.org
>> >> >
>> >> > > >>>> wrote:
>> >> > > >>>> >
>> >> > > >>>> > >
>> >> > > >>>> > >
>> >> > > >>>> > > On 6/27/17 7:20 PM, Stack wrote:
>> >> > > >>>> > >
>> >> > > >>>> > >> * test-patch's whitespace plugin can configured to ignore
>> >> some
>> >> > > >>>> files
>> >> > > >>>> > (but
>> >> > > >>>> > >>> I
>> >> > > >>>> > >>> can't think of any we'd care to so whitelist)
>> >> > > >>>> > >>>
>> >> > > >>>> > >>> Generated files.
>> >> > > >>>> > >>
>> >> > > >>>> > >
>> >> > > >>>> > > Oh my goodness, yes, please. This has been such a pain in
>> the
>> >> > rear
>> >> > > >>>> for me
>> >> > > >>>> > > as I've been rebasing space quota patches. Sometimes, the
>> >> spaces
>> >> > > in
>> >> > > >>>> > > pb-gen'ed code are removed by folks before commit, other
>> >> times
>> >> > > they
>> >> > > >>>> > aren't.
>> >> > > >>>> > >
>> >> > > >>>> >
>> >> > > >>>> > Agree sir. Its a distraction at least.
>> >> > > >>>> >
>> >> > > >>>> > I see Jacoco report here now:
>> >> > > >>>> > https://builds.apache.org/job/HBase-Trunk_matrix/jdk=JDK%
>> >> > > >>>> > 201.8%20(latest),label=Hadoop/3277/
>> >> > > >>>> >
>> >> > > >>>> > Maybe it has been there always and I just haven't noticed.
>> >> > > >>>> >
>> >> > > >>>> > Its all 0%. We need to turn on stuff?
>> >> > > >>>> >
>> >> > > >>>> > St.Ack
>> >> > > >>>> >
>> >> > > >>>>
>> >> > > >>>
>> >> > > >>>
>> >> > > >>
>> >> > > >
>> >> > >
>> >> >
>> >>
>> >
>> >
>> >
>> > --
>> >
>> > -- Appy
>> >
>>
>>
>>
>> --
>>
>> -- Appy
>>
>
>

--001a114c0d62a29d5b055749b0cd--