cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhinandan Prateek <abhinandan.prat...@shapeblue.com>
Subject Re: marvin test cases + travis
Date Sun, 03 May 2015 03:42:52 GMT
I think it is a choice between fast response Vs more accurate response. I will rather wait
for additional 20 minutes to get a better response.
With the commit rate we have that should not overload the system.
Yes we should definitely look for quality and coverage of the tests picked then the number.

> On 01-May-2015, at 11:09 pm, Rajani Karuturi <rajani@apache.org> wrote:
>
> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the
> time I review the code, if CI gives a +1(or -1) I can close the PR then and
> there instead of coming back again to merge.
>
> I would suggest running all the jobs under 30 min and increasing the number
> of parallel jobs as much as possible. we are running 10 jobs now. may be we
> could increase this to 15(dont know if this is possible)
>
> we should aim to run only the smoke tests and not the entire regression
> suite always.
>
> Making the jobs run on containers will speed them up. This needs some work
> on removing the sudo dependency on the jobs (which is required to install
> some additional packages and marvin).
>
> ~Rajani
>
> On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
>> +1 for increased timeouts.
>>
>> At the moment we get less than 24 commits per day on master. Only a couple
>> on other branches per day.
>> We can increase the timeout to upto 70 minutes or more. Will try to ensure
>> that in general a single run does not take more than an hour.
>>
>> A timeout window slightly higher will ensure that we do not see timeout
>> failures.
>>
>>> On 30-Apr-2015, at 11:25 pm, Daan Hoogland <daan.hoogland@gmail.com>
>> wrote:
>>>
>>> Travis is starting to indue the, 'oh,  a timeout again' - blindness in
>> me.
>>> Let's put a safe time on it.  A result should mean something and those
>> time
>>> out are like the (decreasing) abundance of Jenkins failures.
>>>
>>> So +1 for increasing the time
>>>
>>> On Thu, 30 Apr 2015 18:46 Ian Duffy <ian@ianduffy.ie> wrote:
>>>
>>>>> Do we need to ask for an increase in run time?
>>>>
>>>> From my experience I wouldn't say its required however *it would be very
>>>> nice*.
>>>> At the moment what we do is create new parallel jobs and balance the
>>>> tests across them so each job is under 50mins.
>>>>
>>>> Anywho, just my 2c, see what others say/think.
>>>>
>>>> On 30 April 2015 at 17:34, David Nalley <david@gnsa.us> wrote:
>>>>> Do we need to ask for an increase in run time?
>>>>> 50 minutes is the OSS default, but the ASF is a paying customer and we
>>>>> can ask for longer timeouts.
>>>>>
>>>>> --David
>>>>>
>>>>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
>>>>> <abhinandan.prateek@shapeblue.com> wrote:
>>>>>> One of the run did timeout. Will balance the runs.
>>>>>>
>>>>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>
>>>>>>> Yes, thanks for checking. I was worried that now some of them
may
>>>> start timing out.
>>>>>>> I have another 10 suites tested, will add them once everything
seems
>>>> fine.
>>>>>>>
>>>>>>> -abhi
>>>>>>>
>>>>>>>
>>>>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <rajani@apache.org>
>>>> wrote:
>>>>>>>>
>>>>>>>> after correcting the test file path, its working fine
>>>>>>>>
>>>>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ~Rajani
>>>>>>>>
>>>>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi <rajani@apache.org
>>>
>>>> wrote:
>>>>>>>>
>>>>>>>>> I think its due to this commit
>>>>>>>>>
>>>>>>>>>
>>>>
>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
>>>>>>>>>
>>>>>>>>> Here, test file name is changed from testname to
>>>> [smoke,component]/testname
>>>>>>>>>
>>>>>>>>> But, while running each test file in the for loop, it
prepends the
>>>> name
>>>>>>>>> with smoke and hence, it cant find the file and none
of the tests
>> in
>>>> the
>>>>>>>>> file are run
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ~Rajani
>>>>>>>>>
>>>>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
>>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>>>
>>>>>>>>>> It is possible, I will check.
>>>>>>>>>>
>>>>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi <rajani@apache.org>
>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hey Abhi,
>>>>>>>>>>>
>>>>>>>>>>> In the recent travis runs, its not printing the
test case in
>>>> output (
>>>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>>>>>>>>>>>
>>>>>>>>>>> It used to print the test case name and status
(
>>>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>>>>>>>>>>>
>>>>>>>>>>> Do you think it can be due to any recent changes?
>>>>>>>>>>>
>>>>>>>>>>> ~Rajani
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan
Prateek <
>>>>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> There are more than 10 additional suites
that can still be
>>>> included
>>>>>>>>>> to
>>>>>>>>>>>> the travis-CI.
>>>>>>>>>>>> Since the current set runs comfortably I
will go ahead and add
>>>> more. If
>>>>>>>>>>>> the system gets overloaded, then we can balance
the kind of test
>>>>>>>>>> suites and
>>>>>>>>>>>> amount of test suits that run comfortably
on travis.
>>>>>>>>>>>>
>>>>>>>>>>>> -abhi
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Find out more about ShapeBlue and our range
of CloudStack
>> related
>>>>>>>>>> services
>>>>>>>>>>>>
>>>>>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>>>>>>> CSForge – rapid IaaS deployment framework<
>>>>>>>>>> http://shapeblue.com/csforge/>
>>>>>>>>>>>> CloudStack Consulting<
>>>> http://shapeblue.com/cloudstack-consultancy/>
>>>>>>>>>>>> CloudStack Software Engineering<
>>>>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>>>>>>
>>>>>>>>>>>> This email and any attachments to it may
be confidential and are
>>>>>>>>>> intended
>>>>>>>>>>>> solely for the use of the individual to whom
it is addressed.
>> Any
>>>>>>>>>> views or
>>>>>>>>>>>> opinions expressed are solely those of the
author and do not
>>>>>>>>>> necessarily
>>>>>>>>>>>> represent those of Shape Blue Ltd or related
companies. If you
>>>> are not
>>>>>>>>>> the
>>>>>>>>>>>> intended recipient of this email, you must
neither take any
>> action
>>>>>>>>>> based
>>>>>>>>>>>> upon its contents, nor copy or show it to
anyone. Please contact
>>>> the
>>>>>>>>>> sender
>>>>>>>>>>>> if you believe you have received this email
in error. Shape Blue
>>>> Ltd
>>>>>>>>>> is a
>>>>>>>>>>>> company incorporated in England & Wales.
ShapeBlue Services
>> India
>>>> LLP
>>>>>>>>>> is a
>>>>>>>>>>>> company incorporated in India and is operated
under license from
>>>> Shape
>>>>>>>>>> Blue
>>>>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is
a company
>> incorporated
>>>> in
>>>>>>>>>> Brasil
>>>>>>>>>>>> and is operated under license from Shape
Blue Ltd. ShapeBlue SA
>>>> Pty
>>>>>>>>>> Ltd is
>>>>>>>>>>>> a company registered by The Republic of South
Africa and is
>> traded
>>>>>>>>>> under
>>>>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is
a registered
>> trademark.
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
related
>>>> services
>>>>>>>>>>
>>>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>>>>> CSForge – rapid IaaS deployment framework<
>>>> http://shapeblue.com/csforge/>
>>>>>>>>>> CloudStack Consulting<
>> http://shapeblue.com/cloudstack-consultancy/>
>>>>>>>>>> CloudStack Software Engineering<
>>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>>>>
>>>>>>>>>> This email and any attachments to it may be confidential
and are
>>>> intended
>>>>>>>>>> solely for the use of the individual to whom it is
addressed. Any
>>>> views or
>>>>>>>>>> opinions expressed are solely those of the author
and do not
>>>> necessarily
>>>>>>>>>> represent those of Shape Blue Ltd or related companies.
If you are
>>>> not the
>>>>>>>>>> intended recipient of this email, you must neither
take any action
>>>> based
>>>>>>>>>> upon its contents, nor copy or show it to anyone.
Please contact
>>>> the sender
>>>>>>>>>> if you believe you have received this email in error.
Shape Blue
>>>> Ltd is a
>>>>>>>>>> company incorporated in England & Wales. ShapeBlue
Services India
>>>> LLP is a
>>>>>>>>>> company incorporated in India and is operated under
license from
>>>> Shape Blue
>>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
incorporated
>>>> in Brasil
>>>>>>>>>> and is operated under license from Shape Blue Ltd.
ShapeBlue SA
>> Pty
>>>> Ltd is
>>>>>>>>>> a company registered by The Republic of South Africa
and is traded
>>>> under
>>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
trademark.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>>>>
>>>>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>> CSForge – rapid IaaS deployment framework<
>>>> http://shapeblue.com/csforge/>
>>>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>
>>>>>>> This email and any attachments to it may be confidential and
are
>>>> intended solely for the use of the individual to whom it is addressed.
>> Any
>>>> views or opinions expressed are solely those of the author and do not
>>>> necessarily represent those of Shape Blue Ltd or related companies. If
>> you
>>>> are not the intended recipient of this email, you must neither take any
>>>> action based upon its contents, nor copy or show it to anyone. Please
>>>> contact the sender if you believe you have received this email in error.
>>>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>>>> Services India LLP is a company incorporated in India and is operated
>> under
>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>>>> company incorporated in Brasil and is operated under license from Shape
>>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
>> of
>>>> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
>> is
>>>> a registered trademark.
>>>>>>
>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>>>
>>>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>> CSForge – rapid IaaS deployment framework<
>> http://shapeblue.com/csforge/
>>>>>
>>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>
>>>>>> This email and any attachments to it may be confidential and are
>>>> intended solely for the use of the individual to whom it is addressed.
>> Any
>>>> views or opinions expressed are solely those of the author and do not
>>>> necessarily represent those of Shape Blue Ltd or related companies. If
>> you
>>>> are not the intended recipient of this email, you must neither take any
>>>> action based upon its contents, nor copy or show it to anyone. Please
>>>> contact the sender if you believe you have received this email in error.
>>>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>>>> Services India LLP is a company incorporated in India and is operated
>> under
>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>>>> company incorporated in Brasil and is operated under license from Shape
>>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
>> of
>>>> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
>> is
>>>> a registered trademark.
>>>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use
of the individual to whom it is addressed. Any views or opinions expressed are solely those
of the author and do not necessarily represent those of Shape Blue Ltd or related companies.
If you are not the intended recipient of this email, you must neither take any action based
upon its contents, nor copy or show it to anyone. Please contact the sender if you believe
you have received this email in error. Shape Blue Ltd is a company incorporated in England
& Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated
under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company
registered by The Republic of South Africa and is traded under license from Shape Blue Ltd.
ShapeBlue is a registered trademark.
Mime
View raw message