cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daan Hoogland <daan.hoogl...@gmail.com>
Subject Re: marvin test cases + travis
Date Fri, 01 May 2015 18:24:55 GMT
If we can lets increase, but if we can't let's not allow for false negatives

Op vr 1 mei 2015 om 19:39 schreef Rajani Karuturi <rajani@apache.org>:

> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the
> time I review the code, if CI gives a +1(or -1) I can close the PR then and
> there instead of coming back again to merge.
>
> I would suggest running all the jobs under 30 min and increasing the number
> of parallel jobs as much as possible. we are running 10 jobs now. may be we
> could increase this to 15(dont know if this is possible)
>
> we should aim to run only the smoke tests and not the entire regression
> suite always.
>
> Making the jobs run on containers will speed them up. This needs some work
> on removing the sudo dependency on the jobs (which is required to install
> some additional packages and marvin).
>
> ~Rajani
>
> On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
> > +1 for increased timeouts.
> >
> > At the moment we get less than 24 commits per day on master. Only a
> couple
> > on other branches per day.
> > We can increase the timeout to upto 70 minutes or more. Will try to
> ensure
> > that in general a single run does not take more than an hour.
> >
> > A timeout window slightly higher will ensure that we do not see timeout
> > failures.
> >
> > > On 30-Apr-2015, at 11:25 pm, Daan Hoogland <daan.hoogland@gmail.com>
> > wrote:
> > >
> > > Travis is starting to indue the, 'oh,  a timeout again' - blindness in
> > me.
> > > Let's put a safe time on it.  A result should mean something and those
> > time
> > > out are like the (decreasing) abundance of Jenkins failures.
> > >
> > > So +1 for increasing the time
> > >
> > > On Thu, 30 Apr 2015 18:46 Ian Duffy <ian@ianduffy.ie> wrote:
> > >
> > >>> Do we need to ask for an increase in run time?
> > >>
> > >> From my experience I wouldn't say its required however *it would be
> very
> > >> nice*.
> > >> At the moment what we do is create new parallel jobs and balance the
> > >> tests across them so each job is under 50mins.
> > >>
> > >> Anywho, just my 2c, see what others say/think.
> > >>
> > >> On 30 April 2015 at 17:34, David Nalley <david@gnsa.us> wrote:
> > >>> Do we need to ask for an increase in run time?
> > >>> 50 minutes is the OSS default, but the ASF is a paying customer and
> we
> > >>> can ask for longer timeouts.
> > >>>
> > >>> --David
> > >>>
> > >>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
> > >>> <abhinandan.prateek@shapeblue.com> wrote:
> > >>>> One of the run did timeout. Will balance the runs.
> > >>>>
> > >>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
> > >> abhinandan.prateek@shapeblue.com> wrote:
> > >>>>>
> > >>>>> Yes, thanks for checking. I was worried that now some of them
may
> > >> start timing out.
> > >>>>> I have another 10 suites tested, will add them once everything
> seems
> > >> fine.
> > >>>>>
> > >>>>> -abhi
> > >>>>>
> > >>>>>
> > >>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <rajani@apache.org>
> > >> wrote:
> > >>>>>>
> > >>>>>> after correcting the test file path, its working fine
> > >>>>>>
> > >>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> ~Rajani
> > >>>>>>
> > >>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi <
> rajani@apache.org
> > >
> > >> wrote:
> > >>>>>>
> > >>>>>>> I think its due to this commit
> > >>>>>>>
> > >>>>>>>
> > >>
> >
> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
> > >>>>>>>
> > >>>>>>> Here, test file name is changed from testname to
> > >> [smoke,component]/testname
> > >>>>>>>
> > >>>>>>> But, while running each test file in the for loop,
it prepends
> the
> > >> name
> > >>>>>>> with smoke and hence, it cant find the file and none
of the tests
> > in
> > >> the
> > >>>>>>> file are run
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> ~Rajani
> > >>>>>>>
> > >>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek
<
> > >>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> > >>>>>>>
> > >>>>>>>> It is possible, I will check.
> > >>>>>>>>
> > >>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi
<rajani@apache.org
> >
> > >> wrote:
> > >>>>>>>>>
> > >>>>>>>>> Hey Abhi,
> > >>>>>>>>>
> > >>>>>>>>> In the recent travis runs, its not printing
the test case in
> > >> output (
> > >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
> > >>>>>>>>>
> > >>>>>>>>> It used to print the test case name and status
(
> > >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
> > >>>>>>>>>
> > >>>>>>>>> Do you think it can be due to any recent changes?
> > >>>>>>>>>
> > >>>>>>>>> ~Rajani
> > >>>>>>>>>
> > >>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan
Prateek <
> > >>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> > >>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> There are more than 10 additional suites
that can still be
> > >> included
> > >>>>>>>> to
> > >>>>>>>>>> the travis-CI.
> > >>>>>>>>>> Since the current set runs comfortably
I will go ahead and add
> > >> more. If
> > >>>>>>>>>> the system gets overloaded, then we can
balance the kind of
> test
> > >>>>>>>> suites and
> > >>>>>>>>>> amount of test suits that run comfortably
on travis.
> > >>>>>>>>>>
> > >>>>>>>>>> -abhi
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> Find out more about ShapeBlue and our range
of CloudStack
> > related
> > >>>>>>>> services
> > >>>>>>>>>>
> > >>>>>>>>>> IaaS Cloud Design & Build<
> > >>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>>>>>>>> CSForge – rapid IaaS deployment framework<
> > >>>>>>>> http://shapeblue.com/csforge/>
> > >>>>>>>>>> CloudStack Consulting<
> > >> http://shapeblue.com/cloudstack-consultancy/>
> > >>>>>>>>>> CloudStack Software Engineering<
> > >>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>>>>>>>> CloudStack Infrastructure Support<
> > >>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>>>>>>>> CloudStack Bootcamp Training Courses<
> > >>>>>>>>>> http://shapeblue.com/cloudstack-training/>
> > >>>>>>>>>>
> > >>>>>>>>>> This email and any attachments to it may
be confidential and
> are
> > >>>>>>>> intended
> > >>>>>>>>>> solely for the use of the individual to
whom it is addressed.
> > Any
> > >>>>>>>> views or
> > >>>>>>>>>> opinions expressed are solely those of
the author and do not
> > >>>>>>>> necessarily
> > >>>>>>>>>> represent those of Shape Blue Ltd or related
companies. If you
> > >> are not
> > >>>>>>>> the
> > >>>>>>>>>> intended recipient of this email, you must
neither take any
> > action
> > >>>>>>>> based
> > >>>>>>>>>> upon its contents, nor copy or show it
to anyone. Please
> contact
> > >> the
> > >>>>>>>> sender
> > >>>>>>>>>> if you believe you have received this email
in error. Shape
> Blue
> > >> Ltd
> > >>>>>>>> is a
> > >>>>>>>>>> company incorporated in England & Wales.
ShapeBlue Services
> > India
> > >> LLP
> > >>>>>>>> is a
> > >>>>>>>>>> company incorporated in India and is operated
under license
> from
> > >> Shape
> > >>>>>>>> Blue
> > >>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda
is a company
> > incorporated
> > >> in
> > >>>>>>>> Brasil
> > >>>>>>>>>> and is operated under license from Shape
Blue Ltd. ShapeBlue
> SA
> > >> Pty
> > >>>>>>>> Ltd is
> > >>>>>>>>>> a company registered by The Republic of
South Africa and is
> > traded
> > >>>>>>>> under
> > >>>>>>>>>> license from Shape Blue Ltd. ShapeBlue
is a registered
> > trademark.
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>> Find out more about ShapeBlue and our range of
CloudStack
> related
> > >> services
> > >>>>>>>>
> > >>>>>>>> IaaS Cloud Design & Build<
> > >>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>>>>>> CSForge – rapid IaaS deployment framework<
> > >> http://shapeblue.com/csforge/>
> > >>>>>>>> CloudStack Consulting<
> > http://shapeblue.com/cloudstack-consultancy/>
> > >>>>>>>> CloudStack Software Engineering<
> > >>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>>>>>> CloudStack Infrastructure Support<
> > >>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>>>>>> CloudStack Bootcamp Training Courses<
> > >>>>>>>> http://shapeblue.com/cloudstack-training/>
> > >>>>>>>>
> > >>>>>>>> This email and any attachments to it may be confidential
and are
> > >> intended
> > >>>>>>>> solely for the use of the individual to whom it
is addressed.
> Any
> > >> views or
> > >>>>>>>> opinions expressed are solely those of the author
and do not
> > >> necessarily
> > >>>>>>>> represent those of Shape Blue Ltd or related companies.
If you
> are
> > >> not the
> > >>>>>>>> intended recipient of this email, you must neither
take any
> action
> > >> based
> > >>>>>>>> upon its contents, nor copy or show it to anyone.
Please contact
> > >> the sender
> > >>>>>>>> if you believe you have received this email in
error. Shape Blue
> > >> Ltd is a
> > >>>>>>>> company incorporated in England & Wales. ShapeBlue
Services
> India
> > >> LLP is a
> > >>>>>>>> company incorporated in India and is operated under
license from
> > >> Shape Blue
> > >>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
> incorporated
> > >> in Brasil
> > >>>>>>>> and is operated under license from Shape Blue Ltd.
ShapeBlue SA
> > Pty
> > >> Ltd is
> > >>>>>>>> a company registered by The Republic of South Africa
and is
> traded
> > >> under
> > >>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>> Find out more about ShapeBlue and our range of CloudStack related
> > >> services
> > >>>>>
> > >>>>> IaaS Cloud Design & Build<
> > >> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>>> CSForge – rapid IaaS deployment framework<
> > >> http://shapeblue.com/csforge/>
> > >>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/
> >
> > >>>>> CloudStack Software Engineering<
> > >> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>>> CloudStack Infrastructure Support<
> > >> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>>> CloudStack Bootcamp Training Courses<
> > >> http://shapeblue.com/cloudstack-training/>
> > >>>>>
> > >>>>> This email and any attachments to it may be confidential and
are
> > >> intended solely for the use of the individual to whom it is addressed.
> > Any
> > >> views or opinions expressed are solely those of the author and do not
> > >> necessarily represent those of Shape Blue Ltd or related companies. If
> > you
> > >> are not the intended recipient of this email, you must neither take
> any
> > >> action based upon its contents, nor copy or show it to anyone. Please
> > >> contact the sender if you believe you have received this email in
> error.
> > >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> > >> Services India LLP is a company incorporated in India and is operated
> > under
> > >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> > >> company incorporated in Brasil and is operated under license from
> Shape
> > >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> > of
> > >> South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue
> > is
> > >> a registered trademark.
> > >>>>
> > >>>> Find out more about ShapeBlue and our range of CloudStack related
> > >> services
> > >>>>
> > >>>> IaaS Cloud Design & Build<
> > >> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>> CSForge – rapid IaaS deployment framework<
> > http://shapeblue.com/csforge/
> > >>>
> > >>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> > >>>> CloudStack Software Engineering<
> > >> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>> CloudStack Infrastructure Support<
> > >> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>> CloudStack Bootcamp Training Courses<
> > >> http://shapeblue.com/cloudstack-training/>
> > >>>>
> > >>>> This email and any attachments to it may be confidential and are
> > >> intended solely for the use of the individual to whom it is addressed.
> > Any
> > >> views or opinions expressed are solely those of the author and do not
> > >> necessarily represent those of Shape Blue Ltd or related companies. If
> > you
> > >> are not the intended recipient of this email, you must neither take
> any
> > >> action based upon its contents, nor copy or show it to anyone. Please
> > >> contact the sender if you believe you have received this email in
> error.
> > >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> > >> Services India LLP is a company incorporated in India and is operated
> > under
> > >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> > >> company incorporated in Brasil and is operated under license from
> Shape
> > >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> > of
> > >> South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue
> > is
> > >> a registered trademark.
> > >>
> >
> > Find out more about ShapeBlue and our range of CloudStack related
> services
> >
> > IaaS Cloud Design & Build<
> > http://shapeblue.com/iaas-cloud-design-and-build//>
> > CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> > CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> > CloudStack Software Engineering<
> > http://shapeblue.com/cloudstack-software-engineering/>
> > CloudStack Infrastructure Support<
> > http://shapeblue.com/cloudstack-infrastructure-support/>
> > CloudStack Bootcamp Training Courses<
> > http://shapeblue.com/cloudstack-training/>
> >
> > This email and any attachments to it may be confidential and are intended
> > solely for the use of the individual to whom it is addressed. Any views
> or
> > opinions expressed are solely those of the author and do not necessarily
> > represent those of Shape Blue Ltd or related companies. If you are not
> the
> > intended recipient of this email, you must neither take any action based
> > upon its contents, nor copy or show it to anyone. Please contact the
> sender
> > if you believe you have received this email in error. Shape Blue Ltd is a
> > company incorporated in England & Wales. ShapeBlue Services India LLP is
> a
> > company incorporated in India and is operated under license from Shape
> Blue
> > Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil
> > and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
> is
> > a company registered by The Republic of South Africa and is traded under
> > license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message