Mailing-List: contact whirr-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: whirr-dev@incubator.apache.org
Date: Mon, 18 Jul 2011 22:50:57 +0000 (UTC)
From: "Adrian Cole (JIRA)" <jira@apache.org>
To: whirr-dev@incubator.apache.org
Message-ID: 
 <652278826.2041.1311029457662.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <2075924898.21666.1310953560483.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (WHIRR-341) Hard code the images used for
 integration testing
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/WHIRR-341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067365#comment-13067365 ] 

Adrian Cole commented on WHIRR-341:
-----------------------------------

Here's a thought:  summary of my objections are:
1. introduces maintenance and manual discovery of updated image ids
2. not a well documented problem (ex. did this happen during a jclouds upgrade or really randomly)
3. doesn't cover the inputs that can produce problems (ex. location+image+hardware+options such as spot pricing are better)

I think we can get more data about change when it happens, and also have an additional benefit of documentation of what was last tested.  I think we can accomplish the goal of understanding change without preventing it or making change very manual.

Apologies for not offering a solution before, that was lazy of me :)  how's this?

We can create a code helper to check template values against last tested file before running a test.  When the values change, warn and overwrite the file.  On some flag, forcibly use old values.

In this case, we should get our documentation automatically, only implying a check-in.  We also don't need to discover new ids as they will come in automatically.  Finally, on error, testing is easy as you just run with the flag that uses last tested.

(note I don't care json vs yaml)

use basedir to establish lasttested directory (ex. services/cassandra)

serialize inputs to templateBuilder to a string and lookup its corresponding json file. (ex. gogrid/default.json or aws-ec2/ubuntu-10.04.json)

build the template and make a map of ids, check this vs what's in that file

ex. 
map.put("locationId", currentTemplate.getLocation().getId())
map.put("hardwareId", currentTemplate.getHardware().getId())
map.put("imageId", currentTemplate.getImage().getId())

if (!toJson(map).equals(lastTested.toString())
   warn me that we last tested something different

if (useOnlyLastTestedFlag){
   map = fromJson(lastTested)
   template = templateBuilder.imageId(map.get("imageId")...
}

if (!toJson(map).equals(lastTested.toString())
   // serialize to disk


Note that in clouds such as vCloud, or any private cloud image and location ids are different per-user, so we'll probably have to think about this more.  However, this should just "work" with gogrid, rackspace, aws-ec2, elastichosts or any other cloud with public scoped image ids.  If we find "thrashing id" problem on public clouds, it is a sign we should revise our templateBuilder expression.  FWIW: I'm happy to also implement this on the jclouds side so that when whirr goes to next version, you can inspect the last ids jclouds tested against.

> Hard code the images used for integration testing
> -------------------------------------------------
>
>                 Key: WHIRR-341
>                 URL: https://issues.apache.org/jira/browse/WHIRR-341
>             Project: Whirr
>          Issue Type: Sub-task
>          Components: core
>            Reporter: Andrei Savu
>            Assignee: Andrei Savu
>             Fix For: 0.6.0
>
>         Attachments: WHIRR-341.patch
>
>
> I suggest we should hard code the images that we are using for integration testing (the default images selected by Whirr) so that we can make the process more predictable. Right now you don't really know what image jclouds is going to select for you and that makes things complicated. 
> By doing this we should also be able to publish a list of officially supported images for Apache Whirr, a list of images that we should be testing against before making a new release.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira