cloudstack-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Tutkowski <mike.tutkow...@solidfire.com>
Subject Re: community testing
Date Wed, 11 Sep 2013 15:11:49 GMT
Yeah, that would be fantastic if I could test the SolidFire plug-in in such
a way.

I could probably get away with a virtual storage node, as well, because I'm
not testing anything that requires the real hardware.


On Wed, Sep 11, 2013 at 2:10 AM, Sebastien Goasguen <runseb@gmail.com>wrote:

>
> On Sep 11, 2013, at 3:02 AM, Prasanna Santhanam <tsp@apache.org> wrote:
>
> > CloudStack API actions are agnostic of underlying infrastructure and
> > most cases can fall into such a category as you describe. But imagine
> > this - I want to test snapshots ..
> >
> > so i take a snapshot and verify if it backedup correctly against a
> > ceph object store, nfs store or iscsi store. that sort of test is
> > going to involve more than just api actions.
> >
> > or say - i want to test multiple shared networks a VM gets deployed
> > into. Do I assume the deployment has multiple shared networks? Can i
> > add my own network into the deployment?
> >
> > or even - I want to exhaust all the public network IPs and check if
> > the next deployed VM picks up an IP in the new public range I've
> > added. This sort of test assumes that all the necessary networking is
> > in place and also hurts VM deployments of all tests that run at the
> > same time.
> >
> > It's a difficult balance to strike but we have to begin somewhere.
> > Start with the basic minimum that every infra can run. infra specifc
> > tests skip if thing are unsuitable, but will run for someone who wants
> > to test that feature
>
> A small point here to make is that jenkins.cloudstack.org is open to
> anyone.
> Prasanna has created an account for me and I am (slowly) working on adding
> tests for clients including aws.
>
> Anyone could use this jenkins instance, bring in slaves from "home" and
> setup tests…
>
> Back to the solidfire example, I think Mike could easily contribute one
> node that has a solidfire storage, then contribute Marvin tests that would
> run on jenkins.c.o and target his slave specifically. Same for KVM on
> Ubuntu...
>
> -sebastien
>
>
> >
> > On Tue, Sep 10, 2013 at 11:53:15PM -0700, Ahmad Emneina wrote:
> >> That's a good question, I'm not sure how preconditions work with
> >> Marvin cases, but I know the tests are run generically. Say I run
> >> copyvolumeToPrimary (not sure this test exists, hypothetical at the
> >> moment), it gets run against a slew of infrastructure configurations
> >> using local storage as well as shared (NSF, iscsi, ceph...) back
> >> ends. So just dropping my test into a storage suite should give it
> >> some guarantee its hitting a few different storage back-ends. That's
> >> how i understand it works today, I'll defer to Prasanna or Sudha...
> >> Or anyone else that runs tests aggressively to fill in the gaps and
> >> make corrections.
> >>
> >> Ahmad
> >>
> >> On Sep 10, 2013, at 11:43 PM, Marcus Sorensen <shadowsor@gmail.com>
> wrote:
> >>
> >>> But if the test requires some sort of preconfiguration, what then
> (e.g. test NFS primary storage would need a local or remote NFS
> configured)? do I need to roll my own, or can I touch the existing test
> infra and do the preconfigure?
> >>>
> >>> On Sep 11, 2013 12:34 AM, "Prasanna Santhanam" <tsp@apache.org> wrote:
> >>>> Yes - Once your test goes into the repo, it should get picked in the
> subsequent
> >>>> run.
> >>>>
> >>>> Jenkins installations from various companies can be combined into a
> single
> >>>> landing page. Jenkins itself doesn't support master/slave but it does
> through
> >>>> the gearman plugin. It's something I have tried using with VMs but
> not with
> >>>> real infra - but it is entirely possible.
> >>>>
> >>>> On Tue, Sep 10, 2013 at 11:17:53PM -0700, Ahmad Emneina wrote:
> >>>>> I think there are jenkins slaves that run the nicera plugins on/at
> Schuberg
> >>>>> Philis housed infrastructure. The Citrix jenkins nodes also runs
as
> slaves
> >>>>> that connect back to the apache owned/controlled jenkins. No reason
> why
> >>>>> testing infra need be so consolidated, it just so happens no one
is
> putting
> >>>>> their hardware where their mouth is.
> >>>>>
> >>>>> I also assume if your marvin tests get accepted upstream, they'll
be
> >>>>> included in the nightly runs/reports. Prasanna correct me if I'm
> wrong.
> >>>>>
> >>>>>
> >>>>> On Tue, Sep 10, 2013 at 11:02 PM, Marcus Sorensen <
> shadowsor@gmail.com>wrote:
> >>>>>
> >>>>>> CloudStack Dev,
> >>>>>>    I was emailed about some of the testing questions I brought
up
> >>>>>> over the last few threads, and a few things were pointed out
to me
> >>>>>> that I think we should try to remedy.  Primarily, that the testing
> >>>>>> environment is owned by Citrix, the QA team is primarily Citrix-run,
> >>>>>> and the testing done is focused on the use models that Citrix
> >>>>>> develops.
> >>>>>>    I've been assured that the test infrastructure is for everyone,
> >>>>>> and I'm not at all trying to say that there's a problem with
Citrix
> >>>>>> focusing their work on their own interests, but I'm not sure
that
> >>>>>> anyone outside of Citrix really knows how to add their own stuff
to
> >>>>>> this testing infrastructure (perhaps for lack of trying, I don't
> >>>>>> know).
> >>>>>>    I haven't really put together enough thought to know how
to
> tackle
> >>>>>> this, but my gut tells me that we need some sort of community-owned
> >>>>>> testing roll-up, where everyone can do their own testing in
whatever
> >>>>>> infrastructure and submit hourly, daily, weekly results. If
my test
> >>>>>> fits into the Citrix test infrastructure and I can figure out
how to
> >>>>>> get it there, great. If not, I can roll my own and integrate
it via
> >>>>>> some API. For example the SolidFire guys may wan to run automated
> >>>>>> regression testing. That probably won't be doable in the Citrix
> >>>>>> infrastructure, but they may want to script a daily
> >>>>>> git-pull/build/deploy zone/create volume and it seems logical
that
> >>>>>> we'd want to support it.
> >>>>>>    Thoughts? Anyone have experience with such things? Can we
have a
> >>>>>> master/slave scenario with Jenkins? Perhaps the Citrix environment
> >>>>>> already supports something like this via Jenkins API?
> >>>>>>
> >>>>
> >>>> --
> >>>> Prasanna.,
> >>>>
> >>>> ------------------------
> >>>> Powered by BigRock.com
> >
> > --
> > Prasanna.,
> >
> > ------------------------
> > Powered by BigRock.com
> >
>
>


-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkowski@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud<http://solidfire.com/solution/overview/?video=play>
*™*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message