Mailing-List: contact flex-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: flex-dev@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of aharui@adobe.com designates
 64.18.1.183 as permitted sender)
From: Alex Harui <aharui@adobe.com>
To: "flex-dev@incubator.apache.org" <flex-dev@incubator.apache.org>
Date: Thu, 23 Aug 2012 13:49:22 -0700
Subject: Re: Getting Mustella to work.
Thread-Topic: Getting Mustella to work.
Thread-Index: Ac2Bbg5XnJkGYmHVQtSH+ORvu86I2AAAreP5
Message-ID: <CC5BE562.4519F%aharui@adobe.com>
In-Reply-To: 
 <CAMFKFRitpR=ewkPAwXQfLGXyYf=nx=pT=YP4oHPVYvPbdFP44g@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
user-agent: Microsoft-Entourage/13.11.0.110726
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Please use -createImages to generate baselines.  There can be faulty tests
where createImages produces a different image than at compare time.  We wan=
t
to use a consistent technique so we know how things get generated.

It should be rare for a baseline to be missing.  I believe you've said
you've been deleting them so there's a chance you are causing a problem by
doing that.  -createImages always overwrites current images and SVN won't
check them in unless it sees an actual difference.


On 8/23/12 1:29 PM, "Carlos Rovira" <carlos.rovira@codeoscopic.com> wrote:

> Hi Alex,
>=20
> for this kind of message: "Failed CompareBitmap(body:step 3)  Baseline
> image could not be read.  Created image file as a .bad.png."
>=20
> I'm renaming the created image .bad.png to the expected image to pass. Th=
e
> problem here is that there's no image, so I think the one created could b=
e
> valid.
>=20
> If some of the things I post here is not right let me know...
>=20
> 2012/8/23 Alex Harui <aharui@adobe.com>
>=20
>>=20
>>=20
>>=20
>> On 8/23/12 9:29 AM, "Carlos Rovira" <carlos.rovira@codeoscopic.com> wrot=
e:
>>=20
>>> Hi Alex,
>>>=20
>>>=20
>>> 2012/8/23 Alex Harui <aharui@adobe.com>
>>>=20
>>>>=20
>>>> I would use the ImageDiffAir tool to figure out what is different, the=
n
>>>> examine the test to determine which image is the right one.
>>>>=20
>>>>=20
>>> The screen shot is from ImageDiffAir tool.
>> Yes, you can use the getPixel button and/or the pixel reading checkbox t=
o
>> determine the pixel values at certain coordinates to determine in exact
>> detail the differences.
>>>=20
>>>=20
>>>=20
>>>> If the red square asset got changed and is smaller then maybe the
>> baseline
>>>> wasn't refreshed after the asset changed.
>>>>=20
>>>=20
>>> I tried more than one time and remove the images to be generated again,
>> so
>>> I think there's no much to do there
>> I thought you'd already generated new baselines so it was making me thin=
k
>> that the test was unstable.  If that's not the case, then you're probabl=
y
>> ok
>> with just cutting a new one.
>>>=20
>>>=20
>>>>=20
>>>> It could also be differences in rendering between platforms and machin=
es
>>>> and
>>>> then we'll have to decide to exclude it or find a way to fix it.
>>>>=20
>>>>=20
>>> I think this is what is happening since from the capture I sent not onl=
y
>>> red square is different, "Name" text report changes too.
>> Yes, but the position of Name might be dependent on red square size.
>>>=20
>>> As I'm new to mustella and already not have too much experience I'd lik=
e
>>> that someone point me how to proceed with this one.
>>>=20
>> If the new baseline seems stable (a second run shows no differences) the=
n
>> just check it in for now.  If there is a platform/machine difference we'=
ll
>> find those as others run these tests and then try to figure out how to
>> stablize the test.
>>=20
>> It gets trickier for tests of effects because timing can affect the
>> rendering, but most tests don't have moving parts so just getting the
>> folder
>> to run with zero failures on your machine is good enough for now.
>>=20
>> --
>> Alex Harui
>> Flex SDK Team
>> Adobe Systems, Inc.
>> http://blogs.adobe.com/aharui
>>=20
>>=20
>=20

--=20
Alex Harui
Flex SDK Team
Adobe Systems, Inc.
http://blogs.adobe.com/aharui