Mailing-List: contact dev-help@cordova.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cordova.apache.org
Received-SPF: pass (athena.apache.org: domain of mmocny@google.com designates
 209.85.213.182 as permitted sender)
MIME-Version: 1.0
Sender: mmocny@google.com
In-Reply-To: <58142C088411D042B70782AD5D5B23E12539C19B@SYD1217>
References: 
 <CAE6O_-YGUP_qRzKAfdODXpqSen8nSrF+AFBQizMNwkTs9HbL4Q@mail.gmail.com>
 <58142C088411D042B70782AD5D5B23E12539C125@SYD1217>
 <CAE6O_-bV=vi+u3K0imHNCnnSkZpev+VfRu4OSemQGdLUzYi1xg@mail.gmail.com>
 <58142C088411D042B70782AD5D5B23E12539C19B@SYD1217>
From: Michal Mocny <mmocny@chromium.org>
Date: Thu, 30 Oct 2014 19:01:37 -0400
Message-ID: 
 <CAEeF2Tc_mb6e=J+wPjQZA9zg95ooJ-SUPX_PRuuOFHPV49=egg@mail.gmail.com>
Subject: Re: [mobile-spec] consistency and reliability
To: dev <dev@cordova.apache.org>
Cc: Shazron <shazron@gmail.com>, "Toda, Shingo" <ShingoT@fast.au.fujitsu.com>
Content-Type: multipart/alternative; boundary=047d7bdc14e602d5cb0506abde0c

--047d7bdc14e602d5cb0506abde0c
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I've seen that in the past and it usually happens due to misuse of jasmine,
which seems unfortunately quite brittle.  Specifically, if done() isn't
called, or an async event fires after a test has already failed / timed out
and calls done(), or registers new tests with it() etc, weird things will
happen.

Usually its a sign that a test is not handling failures appropriately, but
it is a bit unfortunate that jasmine is so brittle.

-Michal

On Thu, Oct 30, 2014 at 6:10 PM, Toda, Shingo <ShingoT@fast.au.fujitsu.com>
wrote:

> This is exactly what I got too.
>
> Regards,
> Shingo
>
> From: Shazron [mailto:shazron@gmail.com]
> Sent: Friday, October 31, 2014 9:02 AM
> To: dev@cordova.apache.org
> Cc: Toda, Shingo
> Subject: Re: [mobile-spec] consistency and reliability
>
> Seems to be exactly what I am seeing.
> Here's the image as a link: http://i.imgur.com/n6ST1Kd.png?1
>
> On Thu, Oct 30, 2014 at 2:57 PM, Toda, Shingo <ShingoT@fast.au.fujitsu.co=
m
> <mailto:ShingoT@fast.au.fujitsu.com>> wrote:
> Hi Shazron
>
> Our team are running mobilespec for Android, iOS and Windows. I cannot se=
e
> the attachment but we also have been seeing what you=E2=80=99ve gotten si=
nce new
> style mobilespec was introduced. It seems that each plugin test run works
> fine but if all tests get run at once I am likely to get more than one
> report in a run reporting that there are a number of specs like 900 specs
> (I don=E2=80=99t think specs are so much).
>
> I noticed that some of the specs were called more than once when I got
> multiple reports. I usually disable FileTransfer, Globalization and Media
> specs at first then run test for them individually because I saw some of
> those tests got called more than once. This could be just my case so it
> might not be yours.
>
> Regards,
> Shingo
>
> From: Shazron [mailto:shazron@gmail.com<mailto:shazron@gmail.com>]
> Sent: Friday, October 31, 2014 7:54 AM
> To: dev@cordova.apache.org<mailto:dev@cordova.apache.org>
> Subject: [mobile-spec] consistency and reliability
>
>
> `cordova-mobile-spec/createmobilespec/createmobilespec.js --ios
> --globalplugins`
>
> Has anyone gotten mobile-spec to work consistently? I get wildly differen=
t
> results on each run. Sometimes there is more than one report in a run. Se=
e:
>
> [Inline image 1]
>
>

--047d7bdc14e602d5cb0506abde0c--