reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Byung-Gon Chun <bgc...@gmail.com>
Subject Re: appveyor test case failures
Date Thu, 17 Aug 2017 12:45:03 GMT
Thanks, Julia.
Any suggestion to make tests more predictable?

A recent appveyor build failed with the following transient error.
It looks like appveyor's somewhat flacky.

-Gon

Build started
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L2>Fetching
repository commit (9c491d1)...OK
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L3>Total:
14.8 MB in 3722 files
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L4>Restoring
build cache
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L5>Cache
'.\lang\cs\packages' - Restored
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L6>Running
Install scripts
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L7>
.\dev\appveyor-install-dependencies.ps1
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L8>Error
downloading remote file: One or more errors occurred.
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L9>Inner
Exception: Unable to connect to the remote server
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L10>7z.exe
: ERROR: protoc.zip
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L11>At
line:1 char:1
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L12>+
7z.exe x protoc.zip
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L13>+
~~~~~~~~~~~~~~~~~~~
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L14>
+ CategoryInfo : NotSpecified: (ERROR: protoc.zip:String) [],
RemoteException
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L15>
+ FullyQualifiedErrorId : NativeCommandError
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L16>
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L17>Can
not open the file as archive
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L18>
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L19>
<https://ci.appveyor.com/project/ApacheSoftwareFoundation/reef/build/1825-master/job/paijk23lh4a9cd6q#L20>

On Thu, Aug 17, 2017 at 3:35 PM, Julia Wang (QIUHE) <
Qiuhe.Wang@microsoft.com.invalid> wrote:

> Currently the test validation is based on the logs in the log files. The
> log files can only be read after the application is completed and driver is
> shut down. We have test failures in which the driver doesn't shut down
> within the test retry time frame. One of such tests I observed may really
> takes longer than the retry time. In that case, we can simply make the
> retry longer.  But some tests get this issue because the driver really
> didn't shut down for unknown reasons. We need to do deep debug to find root
> cause. The harder part is it is transient and not easy to repro locally. In
> AppVeyor, we cannot get logs.
>
> Julia
>
> -----Original Message-----
> From: Byung-Gon Chun [mailto:bgchun@gmail.com]
> Sent: Wednesday, August 16, 2017 10:30 PM
> To: dev@reef.apache.org
> Subject: appveyor test case failures
>
> Hi,
>
> I'm attaching two recent transient(?) appveyor test case failures.
> It looks like they both failed since they cannot read from a specific log
> file.
> Any ideas on improving the way .NET tests run?
>
> Thanks.
> -Gon
>
>
>
>
> INFO: Running test 2973d5d3. If failed AND log uploaded is enabled, log
> can be find in 2017-08-16\2973d5d3 <https://na01.safelinks.
> protection.outlook.com/?url=https%3A%2F%2Fci.appveyor.com%2Fproject%
> 2FApacheSoftwareFoundation%2Freef%2Fbuild%2F1822-master%
> 2Fjob%2Fsp8l47k7dr68ckfm%23L9400&data=02%7C01%7CQiuhe.
> Wang%40microsoft.com%7C863825a2bc594c5f9ff708d4e5311f4b%
> 7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636385446527527925&sdata=
> iUIiVxt2DMLlyc60UjxA1L87y6dGCKDOVhUanKW4FQE%3D&reserved=0>
> Org.Apache.REEF.Tests.Functional.IMRU.TestFailMapperEvaluatorOnWaiti
> ngForEvaluatorAndExecution.TestFailedMapperOnLocalRuntime
> [FAIL]
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9401&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=Eu%2BrSWH7IO1uwdP1aKoYHSX2SEUrIE1
> X2zR6I4ce%2FsE%3D&reserved=0>
> Cannot read from log file
> C:\projects\reef\lang\cs\bin\x64\Release\Org.Apache.REEF.Tests\REEF_LOCAL_
> RUNTIMEf6ca5fbe\reef-BroadcastReduceDriver-20170816032344768\driver\
> driver.stdout
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9402&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=RnTYLPw3AhJch4Oq1pJ5MV6%
> 2FgrpEuBThfJR%2BPHpW4FA%3D&reserved=0>
> Expected: True
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9403&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=o0A4iJtMTtcgwZHTt%2Bv%
> 2Frx2ZkWfk4bWvrBkpf0L%2Flcc%3D&reserved=0>
> Actual: False
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9404&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=JsXOKqUuQN0WKr0yYA%2FtYpwvo%
> 2FuTef5NttEhv%2FmrsPw%3D&reserved=0>
> Stack Trace:
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9405&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=zMR4XgINIo%
> 2FQl50VMd9ghf1E8m5s2eemY%2Bww%2FIeJJqE%3D&reserved=0>
> Functional\ReefFunctionalTest.cs(287,0): at Org.Apache.REEF.Tests.
> Functional.ReefFunctionalTest.ReadLogFile(String
> logFileName, String subfolder, String testFolder, Int32 retryCount) <
> https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9406&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=yb5R50AntSS56KeJ5I5EGaJH86Tw1y
> XCctoxUO9kMGA%3D&reserved=0>
> Functional\IMRU\TestFailMapperEvaluatorOnWaiti
> ngForEvaluatorAndExecution.cs(52,0):
> at
> Org.Apache.REEF.Tests.Functional.IMRU.TestFailMapperEvaluatorOnWaiti
> ngForEvaluatorAndExecution.TestFailedMapperOnLocalRuntime()
>
>
>
>
> INFO: Running test b0540a0e. If failed AND log uploaded is enabled, log
> can be find in 2017-08-16\b0540a0e <https://na01.safelinks.
> protection.outlook.com/?url=https%3A%2F%2Fci.appveyor.com%2Fproject%
> 2FApacheSoftwareFoundation%2Freef%2Fbuild%2F1822-master%
> 2Fjob%2Fsp8l47k7dr68ckfm%23L9423&data=02%7C01%7CQiuhe.
> Wang%40microsoft.com%7C863825a2bc594c5f9ff708d4e5311f4b%
> 7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636385446527527925&sdata=
> JtTxR6hfAy62knvmig9KfLLaVMsgoFZUK7j3Ot4wBpk%3D&reserved=0>
> Org.Apache.REEF.Tests.Functional.IMRU.TestFailMapperEvaluatorsWithFa
> iledResultHandlerOnDispose.TestFailedMapperOnLocalRuntime
> [FAIL]
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9424&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=oxAdpuZjmVFlPiQkGs%
> 2BuJ62aanoqqYnHzZR5rn3hwko%3D&reserved=0>
> Cannot read from log file
> C:\projects\reef\lang\cs\bin\x64\Release\Org.Apache.REEF.Tests\REEF_LOCAL_
> RUNTIME2973d5d3\reef-BroadcastReduceDriver-20170816032750093\driver\
> driver.stdout
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9425&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=oe8GewuhMjANwBZva8WFTypvQUr6gD
> RS%2Bah6%2BDl0hhQ%3D&reserved=0>
> Expected: True
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9426&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=A4GgYd%2Ffn9tE2tgvxw%2F%
> 2F4kco3dOWLhdqUjpn0qvVbiY%3D&reserved=0>
> Actual: False
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9427&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=%2FA5TKLYbmUHVN%
> 2FEkP9CDJa1Wo4QXmoaJNQIt8xkhEfY%3D&reserved=0>
> Stack Trace:
> <https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9428&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=pDVy1ZLaaTkEX6w3bt6tsFp4iekxOA
> OQtjiuodFQEmM%3D&reserved=0>
> Functional\ReefFunctionalTest.cs(287,0): at Org.Apache.REEF.Tests.
> Functional.ReefFunctionalTest.ReadLogFile(String
> logFileName, String subfolder, String testFolder, Int32 retryCount) <
> https://na01.safelinks.protection.outlook.com/?url=
> https%3A%2F%2Fci.appveyor.com%2Fproject%2FApacheSoftwareFoundation%
> 2Freef%2Fbuild%2F1822-master%2Fjob%2Fsp8l47k7dr68ckfm%
> 23L9429&data=02%7C01%7CQiuhe.Wang%40microsoft.com%
> 7C863825a2bc594c5f9ff708d4e5311f4b%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C636385446527527925&sdata=Q5lpC2R%
> 2BAdyizVcP5hGzzCKwKiGlDYy9szkDWFxyycU%3D&reserved=0>
> Functional\IMRU\TestFailMapperEvaluatorsWithFa
> iledResultHandlerOnDispose.cs(54,0):
> at
> Org.Apache.REEF.Tests.Functional.IMRU.TestFailMapperEvaluatorsWithFa
> iledResultHandlerOnDispose.TestFailedMapperOnLocalRuntime()
>
> --
> Byung-Gon Chun
>



-- 
Byung-Gon Chun

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message